Item — HN Reader

For folks interested in seeing a usecase, I have a panel dashboard of Dallas crime statistics at:

https://crimede-coder.com/graphs/Dallas_Dashboard

Startup takes around a minute (which includes installing various python libraries + loading an external 5mb dataset). But once up and running it is quite responsive. (And works fine on my iphone.)

Many businesses I work with use Tableau free versions, and just manually update the data (since the free doesn't allow direct connections to a datastore). This is a free alternative (I use github actions to build a zipped up csv file that is pulled into the environment).

9 comments

Memory usage seems quite high. According to Browser Task Manager, the tab is consuming 657MB compared to 25-70MB most other tabs are using.

Yes this is part of the price of running it client side instead of having a server do all the data manipulation. It is pretty much a wash for RAM for me vs running locally (local is 200-300 for python + 100-200 for chrome for just that web-page).

Woah, what browser/page combination can fit into ~50Mb these days? I am simply used to the fact that most pages take at least 200Mb RAM in task manager.

did you use the in browser or another external task manager? most pages without videos or some kind of gpu process uses 20~30 MB here (like hacker news for example).

Youd see the sme for any competent pyhon app.

> Startup takes around a minute

On iPad Pro 13" from fall 2023, over NYC area broadband and WiFi, it takes about 8 seconds from clicking your link for the spinner (which seems to hang from seconds 4 - 8) to clear and the filters to become active.

Not sure how long bootstrapping enough Python into Safari on an iPad to run a Panel app would take, but I certainly imagined more than 8 seconds. (Shift refresh takes ~6.)

> Startup takes around a minute

I wonder what your bottleneck was? It was about 20 seconds for me on domestic broadband.

Based on the temperature of my phone after clicking that link, probably CPU or memory.

That's pretty cool. In case anyone reading this is generally interested in crime statistics dashboards, I'll link to the NYPD's: https://compstat.nypdonline.org/

Cool site!

> Many businesses I work with use Tableau free versions, and just manually update the data

Why not just use e.g React/ Angular?

Or is it a question of needing python for the data analytics, and for server cost reasons not wanting it to be run on the server side?

This example could be all javascript (and I try to do that in some scenarios). Most of the other demo's on my site are just javascript/D3 or other libraries even with some slightly more advanced metrics, https://crimede-coder.com/demos.

There are some cases in which I do want python numerical libraries though. Say I wanted to do a forecast ARIMA model based on arbitrary combined inputs for the graphs, or do different types of spatial clustering of the geographic data. Those would be cases pyscript would make sense.

The public dashboards yes IMO easier to not have to worry about server.

Awesome example of using in production! Nice work.

I wish we get over with the loading hickups soon. Do you know if there is any work going on to make it start faster/smaller/less janky?

Maybe some kind of snapshot feature, where you can just load an snapshot of the already initialized state?

Could you somehow "snapshot" the runtime after the initial processing is ready and have clients just load that?

I imagine there's a ton of preprocessing that could be, well, preprocessed.

Does it work on firefox for anyone? The spinner keeps spinning on my MacBook Air.

Working fine for me, Firefox 128.0.3 on Fedora

You can connect tableau public to google sheets