Bear Brown
← All N8N workflows
AI & researchFunctionHTTP RequestInformation ExtractorLM Chat Google GeminiOpenAI Chat Model

Automate Etsy Data Mining with Bright Data Scrape & Google Gemini

Configured with Function, HTTP Request, Information Extractor, LM Chat Google Gemini, and additional nodes. Review the connections and setup before adapting this template.

Download workflow JSONView files on GitHub ↗15 nodes · MIT
Workflow preview
TriggerWhen clicking ‘Testworkflow’Manual TriggerTransformSet Esty Search QueryEdit FieldsWeb / APIPerform Esty WebRequestHTTP RequestAI & modelsGoogle Gemini ChatModelLM Chat Google GeminiRoutingLoop Over ItemsLoop Over ItemsWeb / APIPerform Esty webrequest over the loopHTTP RequestWeb / APIInitiate a WebhookNotification for the…HTTP RequestAI & modelsExtract Item List withthe Product InfoInformation ExtractorAI & modelsGoogle Gemini ChatModel for product infoLM Chat Google GeminiAI & modelsExtract PaginatedResultsetInformation ExtractorFiles / mediaWrite the scrapedcontent to diskRead Write FileCodeCreate a binary dataFunctionTransformSplit OutSplit OutAI & modelsExtract PaginatedResultset With OpenAIInformation ExtractorAI & modelsOpenAI Chat ModelOpenAI Chat Model

Node categories in this workflow

  • Trigger
  • Transform
  • Web / API
  • AI & models
  • Routing
  • Files / media
  • Code

Icons describe general node roles, inferred from node types. Inspect the parameters for the configured action.

Drag to pan; use + and − to zoom. Reconstructed from the exported node positions; nothing runs here. Dashed lines represent non-main connections. Full node names and notes appear below.

How it works

The exported workflow contains the following configured nodes. Their connections are shown above; inspect the JSON for the complete logic, expressions, and external actions.

Workflow node names, types, and operations
NodeCategoryTypeOperation
When clicking ‘Test workflow’TriggerManual TriggerSee node parameters
Set Esty Search QueryTransformEdit FieldsSee node parameters
Perform Esty Web RequestWeb / APIHTTP RequestPOST
Google Gemini Chat ModelAI & modelsLM Chat Google GeminiSee node parameters
Loop Over ItemsRoutingLoop Over ItemsSee node parameters
Perform Esty web request over the loopWeb / APIHTTP RequestPOST
Initiate a Webhook Notification for the extracted dataWeb / APIHTTP RequestSee node parameters
Extract Item List with the Product InfoAI & modelsInformation ExtractorSee node parameters
Google Gemini Chat Model for product infoAI & modelsLM Chat Google GeminiSee node parameters
Extract Paginated ResultsetAI & modelsInformation ExtractorSee node parameters
Write the scraped content to diskFiles / mediaRead Write Filewrite
Create a binary dataCodeFunctionSee node parameters
Split OutTransformSplit OutSee node parameters
Extract Paginated Resultset With OpenAIAI & modelsInformation ExtractorSee node parameters
OpenAI Chat ModelAI & modelsOpenAI Chat ModelSee node parameters

Setup

  1. Download the JSON and import it into an isolated n8n instance. Leave the workflow inactive.
  2. Connect your own credentials through n8n’s credential store. Replace REPLACE_WITH_* values with your resource identifiers.
  3. Inspect API destinations, Code nodes, database queries, file paths, and outbound actions.
  4. Run with synthetic data and harmless destinations. Enable triggers only after checking the actual outputs.

Requirements

An n8n instance with the listed node types and compatible versions. Service-connected workflows may require accounts, credentials, or paid APIs.

Credential types declared in the source

  • googlePalmApi
  • httpHeaderAuth
  • openAiApi

Workflow notes

Note

Note

Deals with the Esty web scraping by utilizing the Bright Data Web Unlocker Product.

The Information Extraction node being used to demonstrate the usage of the N8N AI capabilities.

Please make sure to set the Indeed search query and update the Webhook Notification URL

LLM Usages

LLM Usages

Google Gemini Flash Exp model is being used.

Basic LLM Chain Data Extractor.

Open AI Extraction (Optional)

Open AI Extraction (Optional)

Note - Replace the above workflow with the Open AI Chat Model if needed Please make sure to set the OpenAI Chat Model -> Credential to connect with OpenAi Account

Automate Etsy Data Mining with Bright Data Scrape & Google Gemini

Automate Etsy Data Mining with Bright Data Scrape & Google Gemini

Purpose and structure

This folder contains the Automate Etsy Data Mining with Bright Data Scrape & Google Gemini workflow. Its executable nodes use function, httpRequest, informationExtractor, lmChatGoogleGemini, lmChatOpenAi, manualTrigger, readWriteFile, set, splitInBatches, splitOut. The table and connection map below are derived from the JSON, not an inferred guarantee of behavior.

Setup

Import inactive. Configure your own credentials and replace REPLACE_WITH_* values. Review external destinations and Code nodes before running.

Entry points

When clicking ‘Test workflow’

Verification

Sanitized source candidate; not runtime-tested. This overview is generated from node metadata. Read the folder README for the connection map, credential types, and license.

Attribution

https://github.com/Zie619/n8n-workflows/blob/94007c1445d9258a7da116646b79473e7c7c3282/workflows/Splitout/1721_Splitout_Manual_Automate_Webhook.json MIT; preserve source notices.

Canvas section labels

These name areas of the original canvas; they do not include explanatory instructions.

  • Loop and Perform Paginated Esty Data Extraction

More in AI & research

"Hey Siri, Ask Agent" workflow#️⃣Nostr #damus AI Powered Reporting + Gmail + Telegram(G) - Email Classification