DV-2018: Скорость движения номеров. Визовые бюллетени. Часть 1

Give us a link!

Цитата
Xarthisius пишет .. If you could spend 10-15minutes a day helping that would be greatly appreciated. Cheers, Xarthisius

No problem ☺

Цитата
ВУВ пишет: Xarthisius, Brought 84 times. This is the method you created - is there nothing illegal here?

No, that data is publicly available and free to distribute [1]. We are also not trying to "break" CAPTCHA by any means (like AI, Deep Learning etc). It's still humans that are doing the requests. All we do here is coordinating the effort.

[1] https://ceac.state.gov/CEACStatTracker...right.aspx

Цитата
ВУВ пишет: Xarthisius, I put my efforts and continue to coordinate common efforts with other helpers. But I'm wondering if this database is public, why does not Kentucky publish this information and make it publicly available for download as a single file? Performing repetitive operations is something of the Middle Ages. I have already dialed 109 times.

That's a good question. Up till the middle of 2016, they didn't use CAPTCHAs at all. It was easy to scrape the whole db daily using automated software. Then one day, without any notification or official comment, captchas were added. As far as I know Britsimon sent an official request to KCC asking for an easy way to get access to the whole database, but they simply ignored him... And here we are, with the crowd-sourced campaign being the only reasonable way of getting the data.

Не понял что здесь творится?

Цитата

ВУВ пишет: In other words, you have found a formal legal way to get around the obstacle. If we consider the obstacles created by Kentucky as a ban on free access, then your method can be considered a massive intervention using a channel for individual private use. It can be concluded that such an action can lead to undesirable conclusions, if someone decides to commit it. Maybe there is no need to extract information if the right-holder does not want to make it easily accessible, although it is open? You did not think about it? You try to pull out an array of information through the eye of the needle. Thank you.

I just assume they don't care enough to make it useful. Government mandated them to release the data and they did. Whether it's useful or not, it's not their concern. It would most likely require someone to write some code / change the website etc. They may simply don't have money in their budget to do it. There are more examples of such behavior. DHS' Office of Immigration Statistics often release interesting data, however the do it in a form of Tables in Microsoft Word documents... I cannot think of more useless format for publication of numerical data...

Anyways, if you think that it's not obvious and we're doing something fishy, just don't do that. It's purely voluntary.

Xarthisius,
Ваша позиция понятна.
Такое простое объяснение, как отсутствие бюджетных денег или лень отдельных исполнителей, подходит для любого не логичного действия от чиновников и структур правительства.
В любом случае хотелось бы получить ваше видение совместных действий, с призывом к которым Вы обратились.
Я не против участия и помощи, тем более что результат дает возможность анализировать и делать интересные выводы для обсуждения.
Я произвел действий 200 раз, для вытягивания информации.
Это в 200 раз )))) больше чем необходимо для проверки моего персонального дела в Кентукки.
Ждем результат.
Там осталось 2767 на текущий момент.
Спасибо.

Xarthisius,
Надеюсь Вы не останетесь одиноки в ваших позитивных усилиях.
Добрые люди помогут.

Цитата
ВУВ пишет: Xarthisius, I hope you will not be left alone in your positive efforts. Kind people will help.

Thanks! 200 is a lot! Don't over do it. I know it's a very repetitive and boring task. It's easy to become burned out. I'll try to publish a new batch of data today or tomorrow.
BTW, if you have any suggestions regarding plots, format of the data or you'd like to see new features please let me know. I'll try to visit this forum from time to time.