← All N8N workflows
AI & researchAgentAggregateFilterHtmlHTTP Request

Get companies from database

Configured with Agent, Aggregate, Filter, Html, and additional nodes. Review the connections and setup before adapting this template.

Workflow preview
SubworkflowTextTool WorkflowSubworkflowURLsTool WorkflowAI & modelsOpenAI Chat ModelOpenAI Chat ModelTransformJSON ParserOutput Parser StructuredTransformMap company name andwebsiteEdit FieldsTriggerExecute workflowManual TriggerData storeGet companiesSupabaseTransformSelect company name andwebsiteEdit FieldsTransformSet social media arrayEdit FieldsTransformMerge all dataMergeData storeInsert new rowSupabaseTransformConvert HTML toMarkdownMarkdownTransformRetrieve URLsHtmlTransformSplit out URLsSplit OutTransformRemove duplicatedRemove DuplicatesTransformSet domain to pathEdit FieldsRoutingFilter out invalid URLsFilterTransformAggregate URLsAggregateRoutingFilter out empty hrefsFilterTransformSet domain (text)Edit FieldsTransformAdd protocool to domain(text)Edit FieldsWeb / APIGet website (text)HTTP RequestTransformSet response (text)Edit FieldsTransformSet domain (URL)Edit FieldsWeb / APIGet website (URL)HTTP RequestTransformSet response (URL)Edit FieldsTransformAdd protocool to domain(URL)Edit FieldsAI & modelsCrawl websiteAgent

Node categories in this workflow

  • Subworkflow
  • AI & models
  • Transform
  • Trigger
  • Data store
  • Routing
  • Web / API

Icons describe general node roles, inferred from node types. Inspect the parameters for the configured action.

Drag to pan; use + and − to zoom. Reconstructed from the exported node positions; nothing runs here. Dashed lines represent non-main connections. Full node names and notes appear below.

How it works

The exported workflow contains the following configured nodes. Their connections are shown above; inspect the JSON for the complete logic, expressions, and external actions.

Workflow node names, types, and operations
NodeCategoryTypeOperation
TextSubworkflowTool WorkflowSee node parameters
URLsSubworkflowTool WorkflowSee node parameters
OpenAI Chat ModelAI & modelsOpenAI Chat ModelSee node parameters
JSON ParserTransformOutput Parser StructuredSee node parameters
Map company name and websiteTransformEdit FieldsSee node parameters
Execute workflowTriggerManual TriggerSee node parameters
Get companiesData storeSupabasegetAll
Select company name and websiteTransformEdit FieldsSee node parameters
Set social media arrayTransformEdit FieldsSee node parameters
Merge all dataTransformMergeSee node parameters
Insert new rowData storeSupabaseSee node parameters
Convert HTML to MarkdownTransformMarkdownSee node parameters
Retrieve URLsTransformHtmlextractHtmlContent
Split out URLsTransformSplit OutSee node parameters
Remove duplicatedTransformRemove DuplicatesSee node parameters
Set domain to pathTransformEdit FieldsSee node parameters
Filter out invalid URLsRoutingFilterSee node parameters
Aggregate URLsTransformAggregateSee node parameters
Filter out empty hrefsRoutingFilterSee node parameters
Set domain (text)TransformEdit FieldsSee node parameters
Add protocool to domain (text)TransformEdit FieldsSee node parameters
Get website (text)Web / APIHTTP RequestSee node parameters
Set response (text)TransformEdit FieldsSee node parameters
Set domain (URL)TransformEdit FieldsSee node parameters
Get website (URL)Web / APIHTTP RequestSee node parameters
Set response (URL)TransformEdit FieldsSee node parameters
Add protocool to domain (URL)TransformEdit FieldsSee node parameters
Crawl websiteAI & modelsAgentSee node parameters

Setup

  1. Download the JSON and import it into an isolated n8n instance. Leave the workflow inactive.
  2. Connect your own credentials through n8n’s credential store. Replace REPLACE_WITH_* values with your resource identifiers.
  3. Inspect API destinations, Code nodes, database queries, file paths, and outbound actions.
  4. Run with synthetic data and harmless destinations. Enable triggers only after checking the actual outputs.

Requirements

An n8n instance with the listed node types and compatible versions. Service-connected workflows may require accounts, credentials, or paid APIs.

Credential types declared in the source

  • openAiApi
  • supabaseApi

Workflow notes

Text scraper tool

Text scraper tool

This tool is designed to return all text from the given webpage.

💡 Consider adding proxy for better crawling accuracy.

URL scraper tool

URL scraper tool

This tool is designed to return all links (URLs) from the given webpage.

💡 Consider adding proxy for better crawling accuracy.

Get companies from database

Get companies from database

Retrieve names and websites of companies from Supabase table to process crawling.

💡 You can replace Supabase with other database of your choice.

Set parameters for execution

Set parameters for execution

Pass only name and website values from database.

⚠️ If you use other field namings, update this node.

Crawling agent (retrieve social media profile links)

Crawling agent (retrieve social media profile links)

Crawl website to extract social media profile links and return them in unified JSON format.

💡 You can change type of retrieved data by editing prompt and parser schema.

Insert data to database

Insert data to database

Add new rows in database table with extracted data.

💡 You can replace Supabase with other database of your choice.

⚠️ Note

⚠️ Note

  1. Complete video guide for this workflow is available on my YouTube.
  2. Remember to add your credentials and configure nodes.
  3. If you like this workflow, please subscribe to my YouTube channel and/or my newsletter.

Thank you for your support!

Autonomous AI crawler

Autonomous AI crawler

This workflow autonomously navigates through given websites and retrieves social media profile links.

💡 You can modify this workflow to retrieve other type of data (e.g. contact details or company profile summary).

Get companies from database

Get companies from database

Purpose and structure

This folder contains the Get companies from database workflow. Its executable nodes use agent, aggregate, filter, html, httpRequest, lmChatOpenAi, manualTrigger, markdown, merge, outputParserStructured, removeDuplicates, set, splitOut, supabase, toolWorkflow. The table and connection map below are derived from the JSON, not an inferred guarantee of behavior.

Setup

Import inactive. Configure your own credentials and replace REPLACE_WITH_* values. Review external destinations and Code nodes before running.

Entry points

Execute workflow

Verification

Sanitized source candidate; not runtime-tested. This overview is generated from node metadata. Read the folder README for the connection map, credential types, and license.

Attribution

https://github.com/Zie619/n8n-workflows/blob/94007c1445d9258a7da116646b79473e7c7c3282/workflows/Splitout/0520_Splitout_Filter_Create_Webhook.json MIT; preserve source notices.

More in AI & research