Reliable Cross Domain Requests when the User leaves the Page In this article, I demonstrate how to reliably communicate JSON data to a cross domain server a... 2020-12-11 05:58:00 | 阅读: 69 | 收藏 | incolumitas.com sendbeacon smartphone navigator beacon

Crawling Infrastructure - Introduction In this blog article I will introduce my most recent project: The distributed crawlinginfrastr... 2020-05-19 04:29:00 | 阅读: 72 | 收藏 | incolumitas.com crawling crawl crawler 4444 crawled

Dynamic creation of S3 buckets in many regions Create S3 buckets dynamically with a bash scriptThe script below creates S3 buckets in the AWS... 2020-02-27 01:50:00 | 阅读: 72 | 收藏 | incolumitas.com buckets regions bname s3api slug

The value of work in the coming decades This article makes an attempt to understand and predict the consequences of the rapid automatio... 2020-02-20 09:37:00 | 阅读: 67 | 收藏 | incolumitas.com dollars food workforce cleaning labour

How to dynamically change http/s proxy servers in puppeteer? Find the updated blog post here.Chrome/Puppeteer has a couple of annoying issues when trying t... 2020-02-14 22:06:00 | 阅读: 166 | 收藏 | incolumitas.com proxy puppeteer chrome upstream proxies

Using http/s and socks4/5 proxies with puppeteer and chrome with squid and danted For what reason are proxies used when crawling/scraping with puppeteer?When we are crawling di... 2020-02-13 05:42:00 | 阅读: 136 | 收藏 | incolumitas.com proxy puppeteer danted squid proxyuser

5 crucial tips how to survive riding a motorbike/scooter in Thailand (2019) Except from Libya, Thailand is the second most deadly country in the world for number of road a... 2019-10-27 02:04:00 | 阅读: 55 | 收藏 | incolumitas.com helmet thailand motorbike accident koh

4 reasons why you should NOT travel to Koh Phi Phi Koh Phi Phi and Koh Samui are two infamous Thai islands that I was aware of before I set my foo... 2019-10-23 02:04:00 | 阅读: 39 | 收藏 | incolumitas.com phi koh island tonsai bay

Model Based fuzzing of the WPA3 Dragonfly Handshake Here is a quick link to download my Master Thesis about fuzzing the WPA3 handshake.In the past... 2019-10-20 00:18:00 | 阅读: 70 | 收藏 | incolumitas.com handshake thesis sae wpa3 clogging

Review of the Koh Phangan Full Moon Party in Octobre 2019 This blog post tries to give you an honest impression of my experience during the full moon pa... 2019-10-15 21:30:00 | 阅读: 44 | 收藏 | incolumitas.com hostel jungle moon beach baht

Battling incomplete information: Connect market demand with market supply by Google advertisement scraping and lead crawling The scenarioLet's assume Alexandra is a very well connected women in the law industry and is a... 2019-10-01 02:42:00 | 阅读: 39 | 收藏 | incolumitas.com scrapeulous dui serp scraping

Scraping 1 million keywords on the Google Search Engine This blog post is not a practical guide on how to scrape one million keywords on Google. It rat... 2019-09-18 06:30:00 | 阅读: 52 | 收藏 | incolumitas.com scraping cloud scrape proxy scraped

Scraping with puppeteer and headless chrome deployed to AWS Lambda One of the most pressing issues with web scraping/crawling is the part where you get detected a... 2019-09-01 05:30:00 | 阅读: 62 | 收藏 | incolumitas.com scraper scraping cloud promises

Fuzzing the WPA3 Dragonfly handshake IntroductionIn this blog post we learn how to perform a fuzzing test against a 802.11 authenti... 2019-07-18 07:39:00 | 阅读: 109 | 收藏 | incolumitas.com radiotap sae 802 elem clogging

Struktur: A completely new approach to web scraping For the past couple of years, I spent a lot of time creating web scrapers and information extra... 2019-07-15 23:00:00 | 阅读: 50 | 收藏 | incolumitas.com nth puppeteer scraping selectors struktur

Breaking Google's Recaptcha A captcha is a mechanism to distinguish human users from automated programs (bot). There are ma... 2019-03-02 00:00:00 | 阅读: 41 | 收藏 | incolumitas.com recaptcha navigator chrome captcha

Running a WPA3 access point with hostapd 2.7 and SAE/Dragonfly In my master thesis at HU Berlin I investigate the simultaneous authentication of equals (SAE)... 2019-02-23 02:15:00 | 阅读: 47 | 收藏 | incolumitas.com sae wlan0 nl80211 wpa hexdump

Scraping search engines in 2019 When I started developing a simple Python script in 2012, which later would become the open sou... 2019-02-05 02:00:00 | 阅读: 28 | 收藏 | incolumitas.com scraping crawling scrapeulous scrapy crawler

Programming to improve your life In short: I am fed up with bad music and music apps and streaming platforms such as Spotify, So... 2019-01-03 06:38:00 | 阅读: 30 | 收藏 | incolumitas.com reddit spotify playlist songs youtube

Discontinuation of GoogleScraper in this blog post I am going to briefly outline the reasons why I decided to stop developing t... 2018-12-25 02:00:00 | 阅读: 28 | 收藏 | incolumitas.com scraping scrape puppeteer scraper