Hassan Ali is an indie entrepreneur, AI developer, data analyst, and certified Prompt Engineer (Vanderbilt University) based in Karachi, Pakistan. He builds AI-powered products, trades markets, and documents the journey publicly with 180+ readers on Medium.

What does Hassan Ali write about?

Hassan writes about AI tools, large language models, prompt engineering, geopolitics, trading strategies, Python tools, financial markets, and the builder's journey.

How can I contact Hassan Ali?

You can reach Hassan at business@hassanali.site, on X at @hassanalimali, or through his LinkedIn at linkedin.com/in/hassanalimali.

Jobs Scraper

Completed August 2023

Web ScrapingDataPythonAutomation

View Code

Overview

Jobs Scraper is a commercial-grade job aggregation platform that collects opportunities from multiple job boards and company career pages. It goes beyond simple scraping by providing market insights, salary trends, and intelligent filtering to help job seekers find hidden opportunities.

Features

Multi-Platform Scraping — Aggregates from 50+ job boards and career pages
Intelligent Filtering — AI-powered relevance scoring and duplicate detection
Salary Insights — Estimated salary ranges based on role, location, and experience
Market Trends — See which skills are in demand and trending
Email Alerts — Get notified when new matching jobs are posted
Export Options — Download jobs as CSV, JSON, or send to Google Sheets
API Access — RESTful API for integrating with other tools

Technologies Used

Python — Core scraping and data processing
Scrapy — Large-scale web scraping framework
Selenium — JavaScript-heavy site scraping
PostgreSQL — Job listings database
Elasticsearch — Full-text search and filtering
FastAPI — REST API server
Celery — Scheduled scraping tasks
Docker — Containerized deployment

How It Works

Scheduled Scraping — Celery workers scrape target sites on configurable schedules
Data Processing — Clean, normalize, and deduplicate job listings
Enrichment — Add salary estimates, skills extraction, company info
Indexing — Store in Elasticsearch for fast search and filtering
Delivery — Expose via web interface, email alerts, and API

Challenges & Learnings

Biggest Challenge: Anti-bot measures on job sites (CAPTCHAs, IP blocks, rate limiting).

Solution: Implemented rotating proxy network, request throttling, and headless browser automation for difficult sites.

Key Learning: Respect robots.txt and rate limits. Built in ethical scraping practices from day one.

Future Improvements

Resume parsing and matching
Interview preparation resources
Company review integration
Application tracking system
Chrome extension for one-click job saving

Get the Signal