White list Thread

Yesterday I was working on its program that could gather all the fashion Half-Life but my program gave out after awhile 404 and when I went to the website i was shocked. I was told that I bot and what should I be contacted by email and request a whitelist. I request but have not answered me.

help me please

Can you tell me what you were building?

INtense! wrote:

Can you tell me what you were building?

This project loads the text list of mods series Half-Life games. then he can download the mod that you want. also has a function that loads a random fashion. but in the project there will be more certain functions. I can not tell you more as the project is still in development

I can show just this

Yadi.sk

each folder there every game. in each folder is n.txt and l.txt files

n.txt - name fashion
l.txt - the name of fashion that is used in the link

farther everything is very simple

Edited by: rogueliketboir

I have unblocked your IP, but if you are linking to mods make sure credit is given and the links goto ModDB

INtense! wrote:

I have unblocked your IP, but if you are linking to mods make sure credit is given and the links goto ModDB

you can add me to the white list?

only if we understand what you are trying to do. cloning the site doing thousands of requests a second is not allowed behavour

Good. Here's something else I want to show. this code.

:start

GoSub "ter"

SetVar "[text_prog]" "Генерация"

zmDeleteFolder "[ld]" "" ""

FileExists "![mods]\mods_n_rand.txt" "[true]"

If "[true]" "=" "true"
FileErase "![mods]\mods_n_rand.txt"
FileErase "![mods]\mods_l_rand.txt"
EndIf

CreateFolder "[ld]"

FileExists "![mods]\mods_n.txt" "[true]"

If "[true]" "=" "true"
FileErase "![mods]\mods_n.txt"
EndIf

FileExists "![mods]\mods_l.txt" "[true]"

If "[true]" "=" "true"
FileErase "![mods]\mods_l.txt"
EndIf

FileLen "![mods]\n.txt" "[lod]"

Random "[lod]" "[lod]"

FileRead "![mods]\n.txt" "[lod]" "[d1]"
FileRead "![mods]\l.txt" "[lod]" "[d2]"

FolderExists "![mods]\[d1]\" "[true]"

If "[true]" "=" "true"
GotoLine ":start"
EndIf

DownloadFile "https://www.moddb.com/mods/[d2]/Downloads/" "[ld]\[d1].htm" ""

FileToVar "![ld]\[d1].htm" "[ir]"

SearchStr ">Name" "[ir]" "[ls]" ""

If "[ls]" "=" "0"
GotoLine ":start"
EndIf

SetVar "[game_mode]" "[d1]"

SetVar "[text_prog]" "Поиск файлов этого мода"

FileLen "![ld]\[d1].htm" "[tro]"

Loop "1" "[tro]" "[lol1]"
FileRead "![ld]\[d1].htm" "[lol1]" "[lad]"
SearchStr "
If "[ls]" "<>" "0"
CreateFolder "[mods]\[d1]"
FileWrite "![mods]\[d1]\file.txt" "Append" "[lad]"
endif
EndLoop

FolderExists "[mods]\[d1]" "[true]"

If "[true]" "=" "true"
FileLen "![mods]\[d1]\file.txt" "[tro]"
Loop "1" "[tro]" "[lol1]"
FileRead "![mods]\[d1]\file.txt" "[lol1]" "[lad]"
SearchStr "If "[ls]" "<>" "0"
SubStr "[lad]" "23" "2000" "[los1]"
FileWrite "![mods]\[d1]\file2.txt" "Append" "[los1]"
endif
EndLoop

Loop "1" "[tro]" "[lol1]"
FileRead "![mods]\[d1]\file2.txt" "[lol1]" "[lad]"
SearchStr "" "[lad]" "[ls]" ""
If "[ls]" "<>" "0"
StrDel "[lad]" "[ls]" "2000" "[los1]"
FileWrite "![mods]\[d1]\file3.txt" "Append" "[los1]"
endif
EndLoop

Loop "1" "[tro]" "[lol1]"
FileRead "![mods]\[d1]\file3.txt" "[lol1]" "[lad]"
SearchStr "[#34]>" "[lad]" "[ls]" ""
If "[ls]" "<>" "0"
Math "[ls]-1" "0" "[ls]"
SubStr "[lad]" "1" "[ls]" "[los1]"
Math "[ls]+3" "0" "[ls]"
SubStr "[lad]" "[ls]" "2000" "[los2]"
FileWrite "![mods]\[d1]\mods_l.txt" "Append" "https://www.moddb.com/mods/[los1]"
FileWrite "![mods]\[d1]\mods_n.txt" "Append" "[los2]"
endif
EndLoop

FileLen "[mods]\[d1]\mods_l.txt" "[tor]"

Loop "1" "[tor]" "[lol1]"

SetVar "[text_prog]" "Найдено [tor] файлов. Идёт закачка ссылок [lol1]/[tor]"

FileRead "![mods]\[d1]\mods_l.txt" "[lol1]" "[lad]"
FileRead "![mods]\[d1]\mods_n.txt" "[lol1]" "[las]"
DownloadFile "[lad]" "[mods]\[d1]\[las].htm" ""
EndLoop

FileErase "![mods]\[d1]\file.txt"
FileErase "![mods]\[d1]\file2.txt"
FileErase "![mods]\[d1]\file3.txt"
FileErase "![mods]\[d1]\mods_l.txt"
FileErase "![mods]\[d1]\mods_n.txt"

FileWrite "![mods]\mods_n_rand.txt" "Append" "[d1]"
FileWrite "![mods]\mods_l_rand.txt" "Append" "[d2]"
EndIf

FileLen "![mods]\mods_n_rand.txt" "[lod]"

Loop "1" "[lod]" "[lol]"
FileRead "![mods]\mods_n_rand.txt" "[lol]" "[d1]"
FileRead "![mods]\mods_l_rand.txt" "[lol]" "[d2]"
FolderExists "[mods]\[d1]" "[true]"
If "[true]" "=" "true"
FileList "[mods]\[d1]\*.htm" "Files" "[list]"
ListBoxSize "ListBox1" "[ln]"

Loop "1" "[ln]" "[lol1]"
SetVar "[text_prog]" "Идёт закачка файлов [lol1]/[tro]"
ListBoxGetItem "ListBox1" "[lol1]" "[lo]"
FileLen "![mods]\[d1]\[lo]" "[lod1]"
Loop "1" "[lod1]" "[lol2]"
FileRead "![mods]\[d1]\[lo]" "[lol2]" "[lad]"
SearchStr "Filename" "[lad]" "[ls]" ""
If "[ls]" "<>" "0"
Math "[lol2]+2" "0" "[sss]"
FileRead "![mods]\[d1]\[lo]" "[sss]" "[lad]"
SubStr "[lad]" "1" "2000" "[k]"
StrReplace "[k]" " " "" "[k]" ""
StrReplace "[k]" "" "" "[link]" ""
EndIf
EndLoop

Loop "1" "[lod1]" "[lol2]"
FileRead "![mods]\[d1]\[lo]" "[lol2]" "[lad]"
SearchStr "/start" "[lad]" "[ls]" ""
If "[ls]" "<>" "0"
SubStr "[lad]" "1" "2000" "[k]"
StrReplace "[k]" " " "" "[k]" ""
StrReplace "[k]" "" "" "[k]" ""
StrReplace "[k]" "SearchStr "[#34]" "[k]" "[ls]" ""
StrDel "[k]" "[ls]" "2000" "[k]"
StrIns "https://www.moddb.com" "[k]" "1" "[link2]"

:var

DownloadFile "[link2]\all" "[ld]\[d1]_link.htm" ""
endif
Endloop

FileLen "![ld]\[d1]_link.htm" "[lod1]"

SetVar "[text_prog2]" "Идёт поиск быстрого сервера..."

Loop "200" "[lod1]" "[lol2]"
Loop "200" "100" "[ses]"
FileRead "![ld]\[d1]_link.htm" "[lol2]" "[lad]"
SearchStr "downloads served, [ses]%" "[lad]" "[ls]" ""
If "[ls]" "<>" "0"
Math "[lol2]-3" "0" "[lol2]"
FileRead "![ld]\[d1]_link.htm" "[lol2]" "[lad]"
SubStr "[lad]" "1" "2000" "[k]"
StrReplace "[k]" " SearchStr "[#34]" "[k]" "[ls]" ""
StrDel "[k]" "[ls]" "2000" "[k]"
StrIns "https://www.moddb.com/" "[k]" "1" "[links]"
FileExists "[mods]\[d1]\[link]" "[rad]"
If "[rad]" "=" "false"
SetVar "[text_prog2]" ""
DownloadFile "[links]" "[mods]\[d1]\[lol1] [link]" ""
EndIf
SetVar "[ses]" "100"
SetVar "[lol2]" "[lod1]"
EndIf
EndLoop
EndLoop

else

If "[lol2]" "=" "150"
DownloadFile "[link2]" "[ld]\[d1]_link.htm" ""
GotoLine "var"
EndIf
EndIf
EndLoop
EndLoop
EndIf
EndLoop

GoSub "ter"

SetVar "[text_prog]" "Готово"

tell. and you can make the maximum number of requests per day, how much?

Edited by: rogueliketboir

you can do 100 requests every 10 minutes

INtense! wrote:

you can do 100 requests every 10 minutes

Thank you.

Edited by: rogueliketboir