Исходное сообщение
"Около 390 тысяч сайтов оставили открытыми каталоги .git с ко..." Отправлено пох, 05-Сен-18 10:15
не угадали. So, I used DNS log from the OpenData Rapid 7 project.  This was a 3.5TB text file in JSON format, which shows the individual queries: {"timestamp":"1530259463","name":"<domain>","type":"<a/cname/mx/..>","value":"<ip>"} Linux offers lots of handy Gzip tools (zcat,...), so processing such a large volume of data wasn't a big problem. There was a huge amount of various domains and subdomains on the list and it was necessary to reduce them and select only the "interesting" domains. I only filtered A queries on second-level domains of selected TLDs (generic, European + eu, other major states, popular new TLDs: top, xyz, etc.). That's how I got the list with more than 230 million domains. https://opendata.rapid7.com/ - качайте на здоровье.

Ваше сообщение
Имя*:
EMail:	Для отправки ответов на email укажите знак ! перед адресом, например, !user@host.ru (!! - не показывать email). Более тонкая настройка отправки ответов производится в профиле зарегистрированного участника форума.
Заголовок*:
Сообщение*:	> не угадали. > So, I used DNS log from the OpenData Rapid 7 project. > This was a 3.5TB text file in JSON format, which shows > the individual queries: > {"timestamp":"1530259463","name":"<domain>","type":"<a/cname/mx/..>","value":"<ip>"} > Linux offers lots of handy Gzip tools (zcat,...), so processing such a > large volume of data wasn't a big problem. > There was a huge amount of various domains and subdomains on the > list and it was necessary to reduce them and select only > the "interesting" domains. I only filtered A queries on second-level domains > of selected TLDs (generic, European + eu, other major states, popular > new TLDs: top, xyz, etc.). That's how I got the list > with more than 230 million domains. > https://opendata.rapid7.com/ - качайте на здоровье.
	Введите код, изображенный на картинке: