lynxkite / README.md
darabos's picture
Merge remote-tracking branch 'public/main' into darabos-open-source-merge
663af8e
metadata
title: LynxKite 2000:MM
emoji: 🪁
colorFrom: purple
colorTo: gray
sdk: docker
app_port: 7860

LynxKite 2000:MM Enterprise

LynxKite 2000:MM is a GPU-accelerated data science platform and a general tool for collaboratively edited workflows.

Features include:

  • A web UI for building and executing data science workflows.
  • An extensive toolbox of graph analytics operations powered by NVIDIA RAPIDS (CUDA).
  • An integrated collaborative code editor makes it easy to add new operations.
  • An environment for visually designing neural network model architectures.
  • The infrastructure for easily creating other workflow design environments. See lynxkite-pillow-example for a simple example.

This is the next evolution of the classical LynxKite. The two tools offer similar functionality, but are not compatible. This version runs on GPU clusters instead of Hadoop clusters. It targets CUDA instead of Apache Spark. It is much more extensible.

Structure

  • lynxkite-core: Core types and utilities. Depend on this lightweight package if you are writing LynxKite plugins.
  • lynxkite-app: The LynxKite web application. Install some plugins then run this to use LynxKite.
  • lynxkite-graph-analytics: Graph analytics plugin. The classical LynxKite experience!
  • lynxkite-pillow: A simple example plugin.
  • lynxkite-lynxscribe: A plugin for building and running LynxScribe applications.
  • lynxkite-bio: Bioinformatics additions for LynxKite Graph Analytics.
  • docs: User-facing documentation. It's shared between all packages.

Development

Install everything like this:

uv venv
source .venv/bin/activate
uvx pre-commit install
# The [dev] tag is only needed if you intend on running tests
uv pip install -e lynxkite-core/[dev] -e lynxkite-app/[dev] -e lynxkite-graph-analytics/[dev] -e lynxkite-bio -e lynxkite-lynxscribe/ -e lynxkite-pillow-example/

This also builds the frontend, hopefully very quickly. To run it:

cd examples && lynxkite

If you also want to make changes to the frontend with hot reloading:

cd lynxkite-app/web
npm run dev

Executing tests

Run all tests with a single command, or look inside to see how to run them individually:

./test.sh

Documentation

To work on the documentation:

uv pip install mkdocs-material mkdocstrings[python]
mkdocs serve

License

LynxKite 2000:MM Enterprise is built on top of the open-source LynxKite 2000:MM.

Inquire with Lynx Analytics for the licensing of this repository.