apify-scrapers by casper-studios/casper-marketplace
npx skills add https://github.com/casper-studios/casper-marketplace --skill apify-scrapers使用 Apify actors 从主流社交平台抓取内容。每个平台都针对成本和质量进行了优化设置。
What do you want to scrape?
│
├── Social Media Posts
│ ├── Twitter/X → references/twitter.md
│ │ └── Script: scripts/scrape_twitter_ai_trends.py
│ │
│ ├── Reddit → references/reddit.md
│ │ └── Script: scripts/scrape_reddit_ai_tech.py
│ │
│ ├── LinkedIn → references/linkedin.md
│ │ └── Script: scripts/scrape_linkedin_posts.py
│ │
│ ├── Instagram → references/instagram.md
│ │ └── Script: scripts/scrape_instagram.py
│ │ └── Modes: profile, posts, hashtag, reels, comments
│ │
│ ├── Facebook → references/facebook.md
│ │ └── Script: scripts/scrape_facebook.py
│ │ └── Modes: page, posts, reviews, groups, marketplace
│ │
│ ├── TikTok → references/multi-platform.md
│ │ └── Script: scripts/scrape_multi_platform.py
│ │
│ └── YouTube → references/multi-platform.md
│ └── Script: scripts/scrape_multi_platform.py
│
├── Business/Places
│ ├── Google Maps businesses → references/google-maps.md
│ │ └── Script: scripts/scrape_google_maps.py
│ │ └── Modes: search, place, reviews
│ │
│ └── Contact info from websites → references/contact-enrichment.md
│ └── Script: scripts/scrape_contact_info.py
│ └── Extract: emails, phone numbers, social profiles
│
├── Auto-detect URL type → references/url-detect.md
│ └── Script: scripts/scrape_content_by_url.py
│
├── Trend Analysis (NEW)
│ └── Enriched trend analysis → workflows/trend-analysis.md
│ └── Script: scripts/analyze_trends.py
│ └── Features: velocity scoring, lifecycle staging, opportunity scoring
│
└── Workflows (multi-step)
├── Lead generation → workflows/lead-generation.md
├── Influencer discovery → workflows/influencer-discovery.md
├── Competitor analysis → workflows/competitor-intel.md
├── Trend analysis → workflows/trend-analysis.md
└── Competitor Ads Intelligence (NEW) → workflows/competitor-ads.md
└── Script: scripts/scrape_competitor_ads.py
└── Platforms: Facebook Ads Library, Google Ads Transparency
└── Features: Spend estimates, creative analysis, benchmarking
广告位招租
在这里展示您的产品或服务
触达数万 AI 开发者,精准高效
# Required in .env
APIFY_TOKEN=apify_api_xxxxx
获取你的 API 密钥:https://console.apify.com/account/integrations
python scripts/scrape_twitter_ai_trends.py --query "AI agents" --max-tweets 50
python scripts/scrape_reddit_ai_tech.py --subreddits "MachineLearning,LocalLLaMA" --max-posts 100
python scripts/scrape_linkedin_posts.py author "https://linkedin.com/in/username" --max-posts 30
python scripts/scrape_content_by_url.py "https://x.com/user/status/123456"
python scripts/scrape_instagram.py profile "https://instagram.com/username" --max-posts 20
python scripts/scrape_instagram.py hashtag "#artificialintelligence" --max-posts 50
python scripts/scrape_instagram.py reels "https://instagram.com/username" --max-reels 30
python scripts/scrape_facebook.py page "https://facebook.com/pagename" --max-posts 50
python scripts/scrape_facebook.py reviews "https://facebook.com/pagename" --max-reviews 100
python scripts/scrape_facebook.py marketplace "laptops in san francisco" --max-items 30
python scripts/scrape_google_maps.py search "AI consulting firms in New York" --max-results 50
python scripts/scrape_google_maps.py reviews "ChIJN1t_tDeuEmsRUsoyG83frY4" --max-reviews 100
python scripts/scrape_contact_info.py "https://example.com" --depth 2
python scripts/scrape_contact_info.py --urls-file companies.txt --output contacts.json
python scripts/scrape_competitor_ads.py "Nike" --platforms facebook google --country US --days 30
python scripts/scrape_competitor_ads.py "Nike" "Adidas" "Puma" --compare --output comparison.json
python scripts/scrape_competitor_ads.py --search "running shoes" --country US --max-ads 200
python scripts/scrape_competitor_ads.py "Netflix" "Disney+" --platforms facebook --media-types video --days 7
# 分析特定主题并进行丰富化处理
python scripts/analyze_trends.py "artificial intelligence" --sources google instagram tiktok --days 90
# 在类别中发现趋势话题
python scripts/analyze_trends.py --category technology --discover --top 50
# 比较多个趋势
python scripts/analyze_trends.py "AI" "blockchain" "metaverse" --compare
# 导出 HTML 趋势报告
python scripts/analyze_trends.py "sustainable fashion" --format html --output trend_report.html
| 平台 | Actor | 每项成本 |
|---|---|---|
| kaitoeasyapi/twitter-x-data-tweet-scraper | ~$0.00025 | |
| trudax/reddit-scraper | ~$0.001-0.005 | |
| harvestapi/linkedin-post-search | ~$0.01-0.05 | |
| YouTube | streamers/youtube-scraper | ~$0.01-0.05 |
| TikTok | clockworks/tiktok-scraper | ~$0.005 |
| Instagram (个人主页) | apify/instagram-profile-scraper | ~$0.005 |
| Instagram (帖子) | apify/instagram-post-scraper | ~$0.002-0.005 |
| Instagram (话题标签) | apify/instagram-hashtag-scraper | ~$0.002-0.005 |
| Instagram (Reels) | apify/instagram-reel-scraper | ~$0.005-0.01 |
| Instagram (评论) | apify/instagram-comment-scraper | ~$0.001-0.003 |
| Facebook (主页) | apify/facebook-pages-scraper | ~$0.005-0.01 |
| Facebook (帖子) | apify/facebook-posts-scraper | ~$0.003-0.005 |
| Facebook (评论) | apify/facebook-reviews-scraper | ~$0.002-0.005 |
| Facebook (群组) | apify/facebook-groups-scraper | ~$0.005-0.01 |
| Facebook (Marketplace) | apify/facebook-marketplace-scraper | ~$0.005-0.01 |
| Google Maps (搜索) | compass/crawler-google-places | ~$0.01-0.02 |
| Google Maps (地点) | compass/google-maps-business-scraper | ~$0.01 |
| Google Maps (评论) | compass/google-maps-reviews-scraper | ~$0.003-0.005 |
| 联系人信息丰富化 | lukaskrivka/contact-info-scraper | ~$0.01-0.03 |
| Google Trends | apify/google-trends-scraper | ~$0.01 |
| 趋势分析 (多平台) | Multiple actors | ~$0.50-1.50/run |
| Facebook Ads Library | apify/facebook-ads-scraper | ~$0.75/1K ads |
| Facebook Ads (替代方案) | curious_coder/facebook-ads-library-scraper | ~$0.50/1K ads |
| Google Ads Transparency | lexis-solutions/google-ads-scraper | ~$1.00/1K ads |
| Google Ads (替代方案) | xtech/google-ad-transparency-scraper | ~$0.80/1K ads |
所有抓取的数据都保存到 .tmp/ 目录,文件名带有时间戳:
.tmp/twitter_ai_trends_YYYYMMDD.json.tmp/reddit_ai_tech_YYYYMMDD.json.tmp/linkedin_posts_YYYYMMDD_HHMMSS.jsonAPIFY_TOKEN 存储在 .env 文件中(切勿提交到 git).tmp/ 目录中症状: 脚本以 "Actor run failed" 或超时错误终止 原因: 无效的 actor ID、代理点数不足或 actor 配置问题 解决方案:
症状: 脚本完成但返回 0 个项目 原因: 内容被平台阻止、查询无效或代理被检测到 解决方案:
症状: 脚本因 429 错误或 "rate limited" 消息而失败 原因: 短时间内请求过多 解决方案:
症状: 身份验证错误或 "invalid token" 消息 原因: 令牌过期、被撤销或设置不正确 解决方案:
.env 文件中APIFY_TOKEN 环境变量已加载症状: 连接超时或代理错误 原因: 代理池耗尽或地理限制问题 解决方案:
技能: apify-scrapers → parallel-research 使用场景: 抓取社交媒体帖子,然后通过深度研究进行丰富化 流程:
技能: apify-scrapers → content-generation 使用场景: 从社交媒体趋势创建新闻简报内容 流程:
技能: apify-scrapers → google-workspace 使用场景: 将抓取的数据保存到 Google Drive 供团队访问 流程:
技能: apify-scrapers (trend-analysis) → content-generation 使用场景: 识别趋势话题并创建内容策略 流程:
python scripts/analyze_trends.py "AI productivity" --sources all技能: apify-scrapers (trend-analysis) → parallel-research 使用场景: 监控竞争对手在趋势话题中的可见度 流程:
python scripts/analyze_trends.py --category "your-industry" --discover每周安装量
110
代码仓库
GitHub 星标数
9
首次出现
2026年2月24日
安全审计
安装于
github-copilot110
codex110
kimi-cli110
gemini-cli110
cursor110
amp110
Scrape content from major social platforms using Apify actors. Each platform has optimized settings for cost and quality.
What do you want to scrape?
│
├── Social Media Posts
│ ├── Twitter/X → references/twitter.md
│ │ └── Script: scripts/scrape_twitter_ai_trends.py
│ │
│ ├── Reddit → references/reddit.md
│ │ └── Script: scripts/scrape_reddit_ai_tech.py
│ │
│ ├── LinkedIn → references/linkedin.md
│ │ └── Script: scripts/scrape_linkedin_posts.py
│ │
│ ├── Instagram → references/instagram.md
│ │ └── Script: scripts/scrape_instagram.py
│ │ └── Modes: profile, posts, hashtag, reels, comments
│ │
│ ├── Facebook → references/facebook.md
│ │ └── Script: scripts/scrape_facebook.py
│ │ └── Modes: page, posts, reviews, groups, marketplace
│ │
│ ├── TikTok → references/multi-platform.md
│ │ └── Script: scripts/scrape_multi_platform.py
│ │
│ └── YouTube → references/multi-platform.md
│ └── Script: scripts/scrape_multi_platform.py
│
├── Business/Places
│ ├── Google Maps businesses → references/google-maps.md
│ │ └── Script: scripts/scrape_google_maps.py
│ │ └── Modes: search, place, reviews
│ │
│ └── Contact info from websites → references/contact-enrichment.md
│ └── Script: scripts/scrape_contact_info.py
│ └── Extract: emails, phone numbers, social profiles
│
├── Auto-detect URL type → references/url-detect.md
│ └── Script: scripts/scrape_content_by_url.py
│
├── Trend Analysis (NEW)
│ └── Enriched trend analysis → workflows/trend-analysis.md
│ └── Script: scripts/analyze_trends.py
│ └── Features: velocity scoring, lifecycle staging, opportunity scoring
│
└── Workflows (multi-step)
├── Lead generation → workflows/lead-generation.md
├── Influencer discovery → workflows/influencer-discovery.md
├── Competitor analysis → workflows/competitor-intel.md
├── Trend analysis → workflows/trend-analysis.md
└── Competitor Ads Intelligence (NEW) → workflows/competitor-ads.md
└── Script: scripts/scrape_competitor_ads.py
└── Platforms: Facebook Ads Library, Google Ads Transparency
└── Features: Spend estimates, creative analysis, benchmarking
# Required in .env
APIFY_TOKEN=apify_api_xxxxx
Get your API key: https://console.apify.com/account/integrations
python scripts/scrape_twitter_ai_trends.py --query "AI agents" --max-tweets 50
python scripts/scrape_reddit_ai_tech.py --subreddits "MachineLearning,LocalLLaMA" --max-posts 100
python scripts/scrape_linkedin_posts.py author "https://linkedin.com/in/username" --max-posts 30
python scripts/scrape_content_by_url.py "https://x.com/user/status/123456"
python scripts/scrape_instagram.py profile "https://instagram.com/username" --max-posts 20
python scripts/scrape_instagram.py hashtag "#artificialintelligence" --max-posts 50
python scripts/scrape_instagram.py reels "https://instagram.com/username" --max-reels 30
python scripts/scrape_facebook.py page "https://facebook.com/pagename" --max-posts 50
python scripts/scrape_facebook.py reviews "https://facebook.com/pagename" --max-reviews 100
python scripts/scrape_facebook.py marketplace "laptops in san francisco" --max-items 30
python scripts/scrape_google_maps.py search "AI consulting firms in New York" --max-results 50
python scripts/scrape_google_maps.py reviews "ChIJN1t_tDeuEmsRUsoyG83frY4" --max-reviews 100
python scripts/scrape_contact_info.py "https://example.com" --depth 2
python scripts/scrape_contact_info.py --urls-file companies.txt --output contacts.json
python scripts/scrape_competitor_ads.py "Nike" --platforms facebook google --country US --days 30
python scripts/scrape_competitor_ads.py "Nike" "Adidas" "Puma" --compare --output comparison.json
python scripts/scrape_competitor_ads.py --search "running shoes" --country US --max-ads 200
python scripts/scrape_competitor_ads.py "Netflix" "Disney+" --platforms facebook --media-types video --days 7
# Analyze specific topic with enrichments
python scripts/analyze_trends.py "artificial intelligence" --sources google instagram tiktok --days 90
# Discover trending topics in category
python scripts/analyze_trends.py --category technology --discover --top 50
# Compare multiple trends
python scripts/analyze_trends.py "AI" "blockchain" "metaverse" --compare
# Export HTML trend report
python scripts/analyze_trends.py "sustainable fashion" --format html --output trend_report.html
| Platform | Actor | Cost per Item |
|---|---|---|
| kaitoeasyapi/twitter-x-data-tweet-scraper | ~$0.00025 | |
| trudax/reddit-scraper | ~$0.001-0.005 | |
| harvestapi/linkedin-post-search | ~$0.01-0.05 | |
| YouTube | streamers/youtube-scraper | ~$0.01-0.05 |
| TikTok | clockworks/tiktok-scraper | ~$0.005 |
| Instagram (profile) | apify/instagram-profile-scraper | ~$0.005 |
| Instagram (posts) | apify/instagram-post-scraper | ~$0.002-0.005 |
| Instagram (hashtag) | apify/instagram-hashtag-scraper | ~$0.002-0.005 |
| Instagram (reels) | apify/instagram-reel-scraper | ~$0.005-0.01 |
All scraped data saves to .tmp/ with timestamped filenames:
.tmp/twitter_ai_trends_YYYYMMDD.json.tmp/reddit_ai_tech_YYYYMMDD.json.tmp/linkedin_posts_YYYYMMDD_HHMMSS.jsonAPIFY_TOKEN in .env file (never commit to git).tmp/ directorySymptoms: Script terminates with "Actor run failed" or timeout error Cause: Invalid actor ID, insufficient proxy credits, or actor configuration issue Solution:
Symptoms: Script completes but returns 0 items Cause: Content blocked by platform, invalid query, or proxy being detected Solution:
Symptoms: Script fails with 429 errors or "rate limited" messages Cause: Too many requests in a short time period Solution:
Symptoms: Authentication error or "invalid token" message Cause: Token expired, revoked, or incorrectly set Solution:
.env fileAPIFY_TOKEN environment variable is loadedSymptoms: Connection timeout or proxy errors Cause: Proxy pool exhausted or geo-restriction issues Solution:
Skills: apify-scrapers → parallel-research Use case: Scrape social media posts, then enrich with deep research Flow:
Skills: apify-scrapers → content-generation Use case: Create newsletter content from social media trends Flow:
Skills: apify-scrapers → google-workspace Use case: Save scraped data to Google Drive for team access Flow:
Skills: apify-scrapers (trend-analysis) → content-generation Use case: Identify trending topics and create content strategy Flow:
python scripts/analyze_trends.py "AI productivity" --sources allSkills: apify-scrapers (trend-analysis) → parallel-research Use case: Monitor competitor visibility in trending topics Flow:
python scripts/analyze_trends.py --category "your-industry" --discoverWeekly Installs
110
Repository
GitHub Stars
9
First Seen
Feb 24, 2026
Security Audits
Gen Agent Trust HubFailSocketFailSnykWarn
Installed on
github-copilot110
codex110
kimi-cli110
gemini-cli110
cursor110
amp110
Python PDF处理教程:合并拆分、提取文本表格、创建PDF文件
62,000 周安装
| Instagram (comments) | apify/instagram-comment-scraper | ~$0.001-0.003 |
| Facebook (page) | apify/facebook-pages-scraper | ~$0.005-0.01 |
| Facebook (posts) | apify/facebook-posts-scraper | ~$0.003-0.005 |
| Facebook (reviews) | apify/facebook-reviews-scraper | ~$0.002-0.005 |
| Facebook (groups) | apify/facebook-groups-scraper | ~$0.005-0.01 |
| Facebook (marketplace) | apify/facebook-marketplace-scraper | ~$0.005-0.01 |
| Google Maps (search) | compass/crawler-google-places | ~$0.01-0.02 |
| Google Maps (place) | compass/google-maps-business-scraper | ~$0.01 |
| Google Maps (reviews) | compass/google-maps-reviews-scraper | ~$0.003-0.005 |
| Contact Enrichment | lukaskrivka/contact-info-scraper | ~$0.01-0.03 |
| Google Trends | apify/google-trends-scraper | ~$0.01 |
| Trend Analysis (multi) | Multiple actors | ~$0.50-1.50/run |
| Facebook Ads Library | apify/facebook-ads-scraper | ~$0.75/1K ads |
| Facebook Ads (alt) | curious_coder/facebook-ads-library-scraper | ~$0.50/1K ads |
| Google Ads Transparency | lexis-solutions/google-ads-scraper | ~$1.00/1K ads |
| Google Ads (alt) | xtech/google-ad-transparency-scraper | ~$0.80/1K ads |