AI/firecrawl
1
0
Fork 0
mirror of https://git.mirrors.martin98.com/https://github.com/mendableai/firecrawl synced 2025-08-05 20:26:07 +08:00
Code Issues Packages Projects Releases Wiki Activity

Update excludeTags.ts

Browse Source
This commit is contained in:
Nicolas 2024-10-16 13:40:34 -03:00
parent 2c1a98f019
commit ff906f7750
1 changed files with 0 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
apps/api/src/scraper/WebScraper/utils/excludeTags.ts
View File

@ -3,7 +3,6 @@ export const excludeNonMainTags = [
"footer",
"nav",
"aside",
".header",
".top",
".navbar",
".footer",