PHYMES Extract Transform Load (Data)
Synopsis
The PHYMES etl crate implements the functionality for data wrangling and exploratory data analysis that are often used as function or tool calls in Agentic AI workflows. Specifically, the crate implements functionality to convert documents into columnar tables as implemented in phymes-core
, Data operators over columnar tables, and data visualization from columnar tables. Functionality for general tensor operations using the candle crates from HuggingFace, PDF parsing using the lopdf crate, and data visualization using the plotly crate. All tensor operations can be GPU accelerated using CUDA and CuDNN.