Pinned Loading

1. End_To_End_RAG_System End_To_End_RAG_System Public

   End-to-End RAG (Retrieval-Augmented Generation) System involving combination of data ingestion, vector storage, retrieval, and generation using modern NLP and MLOps practices.

   Python

2. Aviation-Metrics-Extraction-Tool Aviation-Metrics-Extraction-Tool Public

   AI-powered pipeline that ingests aircraft listing spreadsheets, extracts engine data, and generates CSV outputs with calculated aviation performance metrics.

   Python

3. E-Commerce-Event-Streaming-with-Kafka-Iceberg E-Commerce-Event-Streaming-with-Kafka-Iceberg Public

   A scalable, real-time data engineering pipeline for processing e-commerce events using Apache Kafka, Apache Spark Structured Streaming, and Apache Iceberg with S3 storage.

   Python

4. E-Commerce-Analytics-Pipeline E-Commerce-Analytics-Pipeline Public

   A fully automated data pipeline that ingests raw e-commerce datasets into PostgreSQL, transforms them using dbt, and enables powerful analytics. Orchestrated with Apache Airflow and containerized w…

   Python

5. Web_Crawler_Scraper_Version-2 Web_Crawler_Scraper_Version-2 Public

   Production-ready AliExpress scraper using Playwright + Bright Data API. Features concurrent scraping, exponential backoff, NDJSON output, and smart retry logic.

   Python

6. Weather-ETL-Pipeline Weather-ETL-Pipeline Public

   A robust data pipeline that extracts weather forecasts from OpenWeatherMap API, stores raw data in MongoDB, and loads cleaned, structured data into PostgreSQL for analytics. Orchestrated with Prefe…

   Python