K-Pop Birthdays Database

A comprehensive database of K-Pop idol birthdays scraped from kpopping.com and formatted as JSON.

Overview

This project contains Python scripts to scrape K-Pop idol birthday information and generate structured JSON files for easy consumption by applications.

Data Source

The data is sourced from kpopping.com, a community-driven K-Pop database platform. Specifically, the script scrapes birthday information from their monthly idol birthday pages (e.g., https://kpopping.com/database/idol/born-in-the-month-of-January).

Generated Files

• kpop_birthdays.json - Raw scraped data with original date format
• kpop_birthdays_nested.json - Processed data with structured date objects

Usage

Run the scraper:

python generate_kpop_birthdays_json.py

Legal Considerations & Copyright

✅ This Usage is Likely Legal - Here's Why:

1. Factual Data

• Birth dates, names, and group affiliations are factual information
• Facts are generally not protected by copyright law
• This falls under the "factual compilation" category

2. Publicly Available Information

• All scraped data is publicly accessible on kpopping.com
• No login or paywall circumvention required
• Data is displayed on public web pages

3. Robots.txt Compliance

• kpopping.com's robots.txt allows general crawling (User-agent: * Allow: /)
• The site only blocks AI training bots (GPTBot, CCBot, etc.)
• Our scraper is not explicitly disallowed

4. Fair Use Considerations

• Limited scope: Only collecting basic factual data
• Transformative purpose: Converting to structured JSON format
• No commercial harm to the original site
• Attribution provided to the source

⚠️ Recommendations for Responsible Use

1. Rate Limiting: The script includes reasonable delays between requests
2. Attribution: Always credit kpopping.com as the data source
3. Non-Commercial: Keep usage non-commercial or seek permission for commercial use
4. Respect Updates: If kpopping.com updates their robots.txt to disallow this type of scraping, respect their wishes
5. Data Accuracy: Verify important information with original sources

📋 Legal Disclaimer

This project is for educational and personal use. While the scraping of factual data is generally legal:

• Check Local Laws: Web scraping laws vary by jurisdiction
• Respect Terms of Service: Review kpopping.com's terms if using data commercially
• No Warranties: Data accuracy is not guaranteed
• Use Responsibly: Don't overload the source server with requests

🔄 Data Updates

The K-Pop industry is dynamic with new debuts and updates. Re-run the scraper periodically to maintain current data, but always respect the source website's resources and policies.

Attribution

Data sourced from kpopping.com - A community-driven K-Pop database platform.