Imagine being able to generate column-level lineage from SQL queries directly in your browser. It sounds like a dream, but it’s now a reality thanks to a small library that’s been making waves in the data engineering community.
The idea behind this project is to leverage column-level lineage on the front-end, making it possible to visualize data flows or propagate business metadata with ease. While there are already great tools out there that can do this, like sqlglot or OpenLineage, they’re built for Python or Java. This means that if you want to use them in a browser-based app, you’d need to either set up an API to call them or run a Python runtime in the browser via something like Pyodide.
The creator of this library realized that there’s a huge gap between data engineering tooling and front-end use cases. This is why they decided to build a solution that can generate column-level lineage from SQL queries directly in the browser.
The library is still experimental and may change significantly, but it’s definitely worth checking out. If you’re interested in learning more, you can find the repo and demo links below.
Repo: https://github.com/nickBes/meta-sql
Demo: https://nickbes.github.io/meta-sql/