jtwaleson

My use case converted 10TB in only a couple of GB after processing. Downloading that was very cheap.

$ cat alexa myset myset | sort | uniq -u | wc -l 773733 0.77M of Alexa top 1M were not in my list. $ cat alexa alexa myset | sort | uniq -u | wc -l 25842205 I mined 25,842,205 additional domain names.…

On a side note, I recently discovered https://scans.io/ where you can find pretty much all of the data that I collected as well. Might be interesting.…

"The question is not -where- are the life forms capable of interstellar communication, but -when- are they." That is the central point of the argument in the article, yet somehow it's n…

Thanks, that's really useful

That's exactly what I am working on right now. Good to see someone having the same idea.

Interesting that they do this via partnerships with news outlets etc. Last year they adapted search rankings to get everyone producing mobile-friendly pages. They could have done the same here. Great …

Sure, I'm biased. Genuinely curious, do you know many applications being created in Access (or Kexi for that matter)? I haven't seen a new Access app in years.

You're probably right. I think that the number of new applications created with Access is decreasing pretty fast, but the number of active existing applications will decline slowly.

Mendix is one such tool (or platform as it also includes a Cloud offering for hosting the applications). It has rapid application development for web/mobile apps. At its core, it has data schema …

I don't -want- to be negative, but how relevant is this (* nix only, runs on single machine) in a world ruled by browsers? My gut feeling says the Access world is dying rapidly, and if that is tr…

Yes I found that some time afterwards, so I decided not to continue with it ;) I did gather about 1.4M certificates in the process though.

No, but my torrent is just the list of unique domain names and 147MB gzipped.

just out of curiosity, what are you (and the other commenters) planning to use this for? I myself was trying to download all X509 server certificates on the Internet I could find to: - gain some insig…

This was a fun Saturday afternoon project to do actually. I spawned a single c4.8xlarge (10 Gbit) instance in US-EAST-1 (next to where the Common Crawl Public Data Set lives in S3) and downloaded 10TB…

https://all-certificates.s3.amazonaws.com/domainnames.gz?tor...

A couple of months ago I processed all metadata from the Common Crawl project for all indexed domain names. This was about 10TB of metadata and resulted in 26 million domain names. EC2 costs were only…

Stories like this make me very happy not to be an ill person in the USA...

Just now I was able to restart the applications manually, after which functionality was restored. Apps did not resume automatically.

The status page says build and api errors, but I have multiple apps in the free tier (EU) which are completely offline. It seems to be caused by an AWS outage in US East http://status.aws.a…

Mendix - https://www.mendix.com/ - Rotterdam/Amersfoort, The Netherlands - Full Time - ONSITE, INTERNS Mendix allows large companies to build high quality, modern (12-factor) web…

loading fonts on aws pages is slow as hell because of this https://aws.amazon.com/ses/

Congrats from another Dutch company that expanded to the US! We're using GitLab for all our internal source code at Mendix, and are extremely happy with it.

Is there any way to integrate this with ECS? That would be a great feature for me.

Both sides are really creepy. A possible benefit of this experiment is gaining more insight into detecting whether people are happy or sad. Advertisers might soon be able to adapt their ads to a user&…

Oh wow, what if someone in the negatively influenced group committed suicide? It would be unlikely that the tinkering actually caused the suicide, but the media would probably jump to this conclusion …