Building a DIY analytics stack with Apache Kafka, Filebeat, Faust, Apache Pinot, and Superset. — If you run a website you’ll likely have access logs and the ELK (Elastic/Logstash/Kibana) Stack has become the go-to stack for building analytics on top of data stored in access log files. But it’s sometimes fun to live on the wild side and explore alternative approaches to see what’s out…

Building a real-time analytics dashboard on streaming data — Just over a year ago Kenny Bastani wrote a blog post showing how to analyse GitHub Events using Apache Pinot and Kafka. In this blog post, we will build on Kenny’s work, but instead of using Apache Superset to visualise the data, we’ll be using a Python library called Streamlit. …

Tracking Cryptocurrency trading using the LUSID investment data platform — I recently started working at a London FinTech company called Finbourne who make a cloud-based data platform for investment data called LUSID. It’s mostly used by hedge funds, pension companies, and investment banks to store their trading data, but you can use it to store your own personal investment data…

How is the Covid vaccination rollout going in different parts of England? — In the world of Covid data, Thursday afternoons are my favourite because that’s when NHS England publish their weekly vaccinations spreadsheet. In this blog post, we’re going to explore the data published in the spreadsheet to learn how the vaccine rollout is going in different parts of the country. The Data Preamble The…

Learn about the latest updates to NEuler, the Graph Data Science Playground, including a new community detection layout and GDS Sandbox integration. — NEuler (Neo4j Euler) is a UI that simplifies the onboarding process for users of Neo4j’s Graph Data Science Library (GDSL). It was first released in early 2019 when it was used to onboard users of GDSL’s predecessor, the Graph Algorithms Library. Over the last few months, we’ve made changes, which…

NEuler, the Graph Algorithms Playground, now supports the Graph Data Science Library — Just under a year ago we released NEuler, the Graph Algorithms Playground, which made it easy for users to learn how to use the Graph Algorithms Library. Its successor, the Graph Data Science Library, was recently released, which meant that NEuler needed to be updated to use that instead. I’m…

Import databases created in Neo4j Desktop to Neo4j Aura, the graph database as a service. — So we’ve been using Neo4j via Neo4j Desktop for a while now, building up a formidable collection of databases, and then a few weeks ago we learned about the launch of this thing called Neo4j Aura. Neo4j Aura is the simplest way to run Neo4j in the cloud. Completely automated…

The latest release of APOC introduces streaming support for exporting to JSON and GraphML, as well as other features. — This week we released version 3.5.0.6 of APOC, Neo4j’s standard library. tl;dr This release contains the following features and bug fixes: streaming support for export JSON and GraphML string multiplication and fill functions removing custom procedures and functions null issues with apoc.coll.containsAll and Mongo procedure

The latest releases of the Graph Algorithms Library add new functionality to the in memory graph. — Over the last month or so we’ve released new functionality for the Neo4j Graph Algorithms Library, in versions 3.5.11.0, 3.5.12.0 and 3.5.12.1. tl;dr These releases see the following features and bug fixes: support for loading multiple relationship types support for loading multiple node and relationship properties