Apply Edge Start your job search

Data Scraping & Influencer Database Engineer – Social Media / Beauty Influencers + AI Engineer

Korea Shop ABC Egypt · Cairo, Egypt

Apply & track with Apply Edge

Company: IMMI – Influencers Marketing Media InternationalWebsite: immiinfluencers.comInstagram: https://www.instagram.com/koreashopabcegypt/?hl=enProject: Build a database of up to 500,000 skincare & beauty influencers in EgyptIMMI is looking for an experienced Data Scraping, Automation & Data Engineering Specialist to rapidly build a large, clean and searchable influencer database for our AI-powered influencer marketing platform.Main ObjectiveIdentify, collect, clean and structure data for up to 500,000 Egypt-based influencers and creators, with a primary focus on:SkincareK-BeautyBeauty & CosmeticsMakeupDermatology / Aesthetic ContentHair & Body CareTarget platforms include Instagram, TikTok, YouTube and Facebook, using compliant public-data sources, APIs and/or licensed data providers where appropriate.Required DataFor each influencer, we would ideally collect:Full/display nameUsername / handleSocial platformProfile URLFollower countEngagement metricsBeauty/skincare categoryCountry/locationBioProfile image URLPublic business email/contact information where availableAdditional relevant creator metrics where technically availableResponsibilitiesDesign the fastest scalable data-acquisition solutionDiscover relevant Egyptian beauty and skincare creatorsDevelop automated data collection and enrichment pipelinesClean, normalize and validate collected dataRemove duplicate creators across multiple platformsCategorize influencers using keywords, content analysis and/or AIIdentify macro, mid-tier, micro and nano influencersExport structured data to CSV/Excel/database formatIntegrate or bulk upload data into immiinfluencers.comDevelop an automated process for future database updatesMaintain data-quality and error-reporting systemsEnsure collection methods comply with applicable privacy requirements and platform/data-provider rulesProject MilestonesMilestone 1: Architecture, data sources and sample datasetMilestone 2: First 100,000 qualified profilesMilestone 3: 250,000 cumulative profilesMilestone 4: Up to 500,000 cumulative profilesMilestone 5: Deduplication, validation, categorization and final database integrationMilestone 6: Automated updating/enrichment systemCandidates should propose the fastest realistic delivery timeline for each milestone.Required SkillsStrong experience with:PythonWeb/data extraction and automationScrapy, Playwright, Selenium or similar technologiesREST APIs and third-party data APIsLarge-scale ETL/data pipelinesPostgreSQL / MySQL / MongoDB or similar databasesCSV/JSON data processingData cleaning and deduplicationSocial-media data analysisAPI integrationCloud infrastructure and scalable data processingExperience with influencer discovery, social media analytics, beauty data, AI classification or creator-marketing platforms is highly preferred.When ApplyingPlease provide:Relevant scraping/data-engineering projects you have completedExamples of datasets with 100,000+ records, if applicableYour proposed technical approachEstimated number of qualified Egypt-based beauty/skincare influencers realistically obtainableEstimated delivery timeline for 100K / 250K / 500K profilesTotal project costCost per 100,000 qualified profilesProposed solution for ongoing automated updatesTechnologies/APIs/data providers you recommend usingPriority will be given to candidates who can demonstrate experience building large-scale social-media or influencer databases and can begin immediately.