The Gap Finder Skill

90 Days Of
Content Strategy
From Real Data

Scrape your competitors' posts. Transcribe their videos. Hand it all to Claude. Walk away with what's already working in your niche, what nobody is touching, and a 90-day content calendar built from real engagement data, not vibes.

Why this works

Most creators waste their best hours staring at a blank doc trying to invent ideas. Your next series is already public. The hits are in your competitors' top posts. The gaps are in what they keep missing. You just need a way to read it at scale, and that is exactly what this workflow is for.

The trick: Claude cannot scrape Instagram, TikTok, or YouTube on its own. So we use Apify to pull every post, every caption, every engagement count, and every video transcript from 5 to 10 competitors. Then we drop the whole dataset into Google Drive and let Claude do the actual analysis.

A content consultant named Marc Rutten documented this exact workflow on Apify's blog: scrape competitor accounts, find the engagement-to-revenue gap, sell the analysis back to brands. The version below is the same playbook, tuned for creators and small business owners running their own content.

Setup The full 8-step workflow

First time through, expect about 90 minutes end-to-end. Every run after the first one takes 20 minutes because everything is already wired up.

Step 01

Sign up for Apify (free)

Go to apify.com and create a free account. No credit card. The free plan gives you $5 of usage credit every month, which resets and is enough for a 5 to 10 competitor scrape with full video transcription.

Step 02

Pick your 5 to 10 competitors with Claude's help

Before scraping, get the list right. Open Claude and run the competitor picker prompt below. It surfaces the right mix of direct competitors, adjacent creators, and one or two wildcard accounts whose audience overlaps with yours.

Copy this prompt into Claude before you open Apify. It builds the exact 5 to 10 handles you'll feed into the scrapers in Steps 3 to 5, including the reasoning behind each pick so the final analysis is sharper.

You are my content strategist. Your job is to help me pick the right 8 competitors to scrape and analyze for my Gap Finder run. The wrong competitors waste my Apify credits and produce a useless analysis. The right ones surface the real opportunities in my niche. My inputs: - My niche in one sentence: [DESCRIBE. E.g. "AI education for non-technical professionals"] - The platforms I post on: [Instagram / TikTok / YouTube / LinkedIn / multiple] - My current follower count and average engagement: [NUMBERS] - 3 creators or brands I KNOW I want analyzed: [LIST handles] - My monthly content goal: [followers / leads / sales / authority / saves / shares] - One angle I want to own that I haven't seen anyone else do well: [DESCRIBE OR "NOT SURE YET"] Do five things. 1. CONFIRM OR REPLACE MY 3 PICKS For each of the 3 creators I named, tell me whether they are actually a good competitor to study (right audience size, posting in my niche, engaged audience). If any of them is a bad pick, replace them with a stronger choice and explain why. 2. ADD 3 DIRECT COMPETITORS I HAVEN'T NAMED Find 3 creators or brands in my exact niche, in my follower-count range or one tier above me. These are the people whose playbook I'm trying to read. For each: handle, follower count, why they're on this list, what I think they're doing that's working. 3. ADD 2 ADJACENT CREATORS Find 2 creators in adjacent niches whose audience overlaps with mine but who aren't direct competitors. Crossover audiences are where the next 1,000 followers usually come from. For each: handle, follower count, the overlap with my niche, what content style of theirs I might steal. 4. THE FINAL LIST OF 8 Give me a clean numbered list of all 8 handles I should scrape, in the format I can paste directly into Apify. Use the @username format for Instagram and TikTok. For YouTube, give me the channel URL. 5. WHAT I'M LOOKING FOR IN EACH ONE For each of the 8, write ONE sentence on the specific question I should answer after analyzing their content (e.g., "For @username: do their high-engagement posts skew to talking-head or screen-recording format?"). This guides the Step 8 analysis prompt. Be specific and honest. If my 3 named picks are weak, say so. If my niche is too broad to analyze, push me to narrow it before we start scraping.

Step 03

Scrape Instagram with Apify's Instagram Scraper

Open apify/instagram-scraper (231K users, most-used Instagram scraper on Apify). Paste your competitor handles into the directUrls or usernames field. Set resultsLimit to 30 per handle (enough to see what's working without blowing your free credit). Hit Start. About 5 to 10 minutes per run. You'll get a dataset with caption, hashtags, likes, comments, view count, video URL, image URL, and post timestamp for every post.

Pricing reality: $1.50 per 1,000 results. Your $5 free monthly credit covers about 3,300 posts, which is way more than you'll need.

Step 04

Scrape TikTok with Clockworks TikTok Scraper

If your competitors post on TikTok, open clockworks/tiktok-scraper (the consensus default TikTok actor in 2026). Same flow: paste handles, set maxItems to 30 per handle, hit Start. Captures caption, video URL, plays, hearts, comments, shares, hashtags, and music metadata.

Pricing reality: about $5 per 1,000 results. Always cap maxItems so a too-broad input doesn't blow your credit in one run.

Step 05

Scrape YouTube (if anyone in your list runs a channel)

Open streamers/youtube-scraper for video metadata (title, views, upload date, description, duration). YouTube transcripts are pulled separately: use topaz_sharingan/youtube-transcript-scraper with your top 20 to 30 videos per channel. Native captions cost almost nothing to scrape.

Step 06

Transcribe the videos that matter

For Instagram Reels and TikToks, you need the actual words said in each video. The cleanest 2026 actor for this is electrifying_haircut/instagram-reel-analyzer. It scrapes the Reel AND transcribes via Whisper in one run. Cost: about $0.007 per Reel, so transcribing the top 10 Reels for each of your 8 competitors (80 Reels total) runs about $0.56.

For TikTok, run invideoiq/video-transcriber on the top 10 TikToks per handle. Same logic, similar cost.

Why transcripts matter: captions are the marketing copy. The actual video is the content. Without transcripts you're analyzing the wrapper, not the product. This is the step most "competitor analysis" workflows skip, which is exactly why your analysis will be sharper than 95% of what creators do.

Step 07

Export everything to one Google Drive folder

In each Apify dataset, click Export → CSV. Download every CSV. Create a Google Drive folder called "Gap Finder / [Date]" and upload them all: instagram-scrape.csv, tiktok-scrape.csv, youtube-scrape.csv, instagram-transcripts.csv, tiktok-transcripts.csv, youtube-transcripts.csv. One folder, six files, ready for analysis.

Step 08

Open Claude with the Drive connector, run the Gap Finder prompt

Open Claude Cowork. Make sure your Google Drive connector is turned on (Settings → Connectors). Create a new project called "Gap Finder". Tell Claude to read from your "Gap Finder / [Date]" folder. Then paste the master Gap Finder prompt below.

Copy this prompt into Claude after the Drive folder is loaded. It runs the full analysis: top patterns to ride, gaps to own, a 90-day calendar of 12 specific pieces of content with hooks, AND your sharpened positioning statement. This is the deliverable the whole workflow was built for.

You are my Senior Content Strategist. Your job is to read every CSV in my "Gap Finder / [DATE]" folder in Google Drive and hand me a publishable content strategy backed by real engagement data, not vibes or guesses. Read the data carefully before you write a single line of analysis. Cite specific posts as evidence. INPUTS YOU'LL FIND IN THE DRIVE FOLDER - instagram-scrape.csv: caption, hashtags, likes, comments, views, video URL, post URL, timestamp, ownerUsername for every Instagram post - tiktok-scrape.csv: same columns for TikTok - youtube-scrape.csv: title, views, duration, upload date, description, channel for every YouTube video - instagram-transcripts.csv: full transcripts of the top 10 Reels per competitor - tiktok-transcripts.csv: full transcripts of the top 10 TikToks per competitor - youtube-transcripts.csv: full transcripts of the top YouTube videos per channel MY CONTEXT - My niche: [PASTE] - My platforms: [PASTE] - My current follower count and engagement: [PASTE] - My content goal next 90 days: [followers / leads / sales / authority / saves / shares] - My non-negotiables (topics I won't make, brands I won't reference): [PASTE OR "NONE"] - My voice in 3 words: [PASTE] DO SIX THINGS. PRODUCE EACH AS A NUMBERED SECTION. 1. THE ENGAGEMENT BASELINE For each competitor, compute their average likes, comments, and view-to-follower ratio across the scrape. Identify their top 5 highest-engagement posts in absolute terms AND in ratio terms (some 100K accounts get more engagement on a "small" post than 500K accounts). Rank competitors by engagement health, not follower count. Surface the one competitor who is punching above their weight (best ratio of engagement to followers). They are the one to study hardest. 2. THE 10 PATTERNS THAT ARE WORKING Read the transcripts AND the captions. Find the 10 patterns that show up across multiple competitors' top posts. For each pattern, give me: - The pattern name (e.g., "the 60-second screen-recording walkthrough with a $-saved hook") - The format (Reel / Carousel / Long-form video / Static image) - The angle / hook (the specific opening line or framing that does the work. Quote real examples from the transcripts) - 3 specific example posts with URLs from my scraped data - Why it works (the emotional or status trigger underneath) - Confidence score 1-10 that this would work for me too, given my voice and goal Rank by confidence. Number them 1 through 10. 3. THE 5 GAPS NOBODY IS TOUCHING Now look at what is missing across this entire competitor set. For each gap, give me: - The topic - Why it's a gap (specifically: is the audience asking for this in the comments of competitor posts? Is there a paid product solving this? Is there a recent news event nobody has covered cleanly?) - The angle I should take given my voice - The first 3 pieces of content I would make in this opening, each with the exact one-line hook - Confidence score 1-10 Rank by confidence. Top 5. 4. THE COMMENT-SECTION INSIGHT Open every top-engagement post's comments (use the post URLs to fetch them if the data isn't already in the CSV). What are people ASKING for that competitors are not delivering in follow-up content? Surface the 3 most common comment-section questions across the dataset. These are content briefs handed to you for free. 5. THE 90-DAY CONTENT CALENDAR Build me a 90-day calendar with 12 specific pieces of content (1 per week, slightly under "post 1x/week" cadence to leave room for trial reels and inspiration drops). 8 are "ride the wave" pieces from Section 2, 4 are "own the gap" pieces from Section 3. For each piece: - Week number (1-12) and platform (Instagram / TikTok / YouTube / cross-post) - Working title and hook (one sentence) - Format (Reel, carousel, long-form, etc.) - The specific competitor post(s) I'm taking inspiration from (with URLs) - The angle that makes mine different from theirs - The single metric I'm watching to know if it worked 6. THE SHARPER POSITIONING Based on what's saturated in my niche AND what's missing, write me a sharpened one-sentence positioning statement I should add to my bio, my email signature, and my LinkedIn headline. Then write 3 hook variations of that statement I can A/B test as Instagram bio lines for the next 90 days. VOICE GUARDRAILS - Write in clear, direct English. No "synergies", no "elevate", no copywriter-coded language. - Cite real post URLs and real transcript quotes. Never make up examples. - When you're not sure or the data is sparse, say so explicitly. - Push back on my non-negotiables if the data shows I'm leaving money on the table by avoiding a topic. END WITH ONE BLUNT PARAGRAPH Tell me the one thing I should stop doing immediately based on what the data shows about my niche. Specific, not motivational. (Example tone: "Stop posting carousel-format hot takes on Tuesdays. Across 6 of the 8 accounts I analyzed, that format underperformed talking-head Reels by 4-7x. The data is consistent enough that this is the single highest-leverage change you can make this week.")

If you only do this once a quarter

One run gives you 90 days of content direction backed by real data. Stack 4 runs a year and you have a content engine that compounds. The hard part is the first run. Block 90 minutes this weekend and you have a quarter of clarity by Sunday night.

Stack with these

Once you have the list of ideas, pair them with Stop using AI to post more, start using AI to post better for the writing voice rules, and 10 Claude Connectors for the workflows that get the content out the door fast.

The Only AI Masterclass You Need

Build AI Systems That Run Your Work, Business, And Life

If this guide helped, but you’re looking to go deeper, I got you!! My 30-Day Challenge takes you from saving AI tips you never use to actually building with AI, step-by-step.

I show you exactly how I automated two e-commerce brands, my social media, and most of my personal life, then hand you the agents, workflows & systems to do the same. I’m teaching you every single thing I know with one lesson and one build a day.

Join the AI Masterclass →

© 2026 Mariah Brunner. All rights reserved.