Building on HF

12 14 25

Parag Ekbote

AINovice2005

https://paragekbote.github.io/

AI & ML interests

ML Engineer passionate about taking models from research to production. 1 year supporting tech startups. Active OSS contributor.

Recent Activity

posted an update about 4 hours ago

Excited to share the release of dagster-hf-datasets: A Dagster-native integration that brings Hugging Face Datasets into Dagster's asset-oriented orchestration model The integration enables: • 🤗 Dataset and DatasetDict assets • 🐙 Dagster asset lineage and observability • 📦 Parquet-backed materialization via HFParquetIOManager • 🚀 Publishing curated datasets back to the Hugging Face Hub • 📝 Automatic dataset card generation from pipeline metadata As the Hub continues to grow beyond 1M+ datasets, orchestration, reproducibility, and observability are becoming increasingly important parts of the dataset lifecycle. I'm also working on a longer article covering the architecture and data pipelines enabled by the integration. More Soon! https://github.com/dagster-io/community-integrations/tree/main/libraries/dagster-hf-datasets https://github.com/dagster-io/community-integrations/tree/main/libraries/dagster-hf-datasets/docs

updated a dataset 1 day ago

AINovice2005/golden-glue-qqp

updated a Space 4 days ago

the-hf-stack/README

View all activity

Organizations

AINovice2005 's Spaces 9

My Optuna Study V2 J2tswB7kWj0

🎯

Display real‑time I/O activity dashboard

My Optuna Study KtRoeiWYDoU

🎯

Show interactive tracking visualizations

My Project LtCV9RUj9Ko

🎯

Show an interactive tracking dashboard

Zenml F5J4jOGLJ44

🎯

Display an interactive tracking dashboard

Ray Trackio Dashboard

🚀

Display interactive tracking dashboard

Trackio

🚀

Show an interactive tracking dashboard for your data

Optuna Dashboard

🚀

Display real-time object tracking

Hf Cookbook Hpo

📊

Optuna-based hyperparameter search for transformer models

Case Study

📚

Lessons learnt from contributing 90+ PRs.