AI/firecrawl
1
0
Fork 0
mirror of https://git.mirrors.martin98.com/https://github.com/mendableai/firecrawl synced 2025-08-12 11:38:59 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,115 Commits 496 Branches 17 Tags
Commit Graph

2115 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Nicolas
93b7b313d6
Merge pull request #654 from mendableai/fix/issue-644 
fix(py-sdk): removed asyncio package
 2024-09-10 10:27:24 -03:00
rafaelsideguide
ee8a54213c fix(py-sdk): removed asyncio package 
tested websocket with example.py without asyncio and it works with no problem.
 2024-09-10 10:25:27 -03:00
rafaelsideguide
1074e976cd Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-09-10 09:09:43 -03:00
rafaelsideguide
45237a29dd updated js-sdk examples 2024-09-10 09:09:39 -03:00
Nicolas
a7406031fa Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-09-10 06:53:30 -03:00
Nicolas
a17e1cac92 Rate bump 2024-09-10 06:53:24 -03:00
Gergo Moricz
b4dbf75537 fix(v1): check if url is string in blocklistMiddleware 
Fixes FIRECRAWL-SCRAPER-JS-9Z
 2024-09-10 10:25:14 +02:00
Gergo Moricz
26f2095de6 fix(v1): proper Invalid URL handling 2024-09-10 09:24:23 +02:00
Gergo Moricz
f8fbc71f91 fix(supabase-jobs): do not use RPCs 
RPCs are more failure-prone for this use case than regular queries are.
 2024-09-10 09:20:18 +02:00
Gergo Moricz
a6bcf7b438 fix(v0/crawl-status): don't crash on big crawls when requesting jobs from supabase 2024-09-10 08:53:40 +02:00
Nicolas
2cbc4c59ce
Merge pull request #649 from mendableai/nsc/chrome-cdp-for-params 
Better engine for wait + other params
 2024-09-09 21:12:46 -03:00
Nicolas
17e419a7fb Nick: 2024-09-09 21:06:23 -03:00
Nicolas
31e973d915
Merge pull request #648 from mendableai/nsc/fix-json-error-handler 
Fixed 500 errors when JSON is badly formatted
 2024-09-09 12:28:18 -03:00
Nicolas
ca9a781eb7 Update index.ts 2024-09-09 12:27:55 -03:00
Nicolas
22a5e85899 Update index.ts 2024-09-09 12:26:55 -03:00
y5n
4278fae51e
Update README.md 2024-09-09 10:55:31 +08:00
Nicolas
60a15d00eb Update types.ts 2024-09-08 16:39:12 -03:00
Nicolas
84fb00ec3f
Merge pull request #640 from mendableai/nsc/improved-billing-notifications 
Improved team credits check and billing notifications
 2024-09-08 13:07:45 -03:00
Nicolas
fbdfa1256b Update credit_billing.ts 2024-09-08 13:07:10 -03:00
Nicolas
48c665519e Update credit_billing.ts 2024-09-07 13:42:45 -03:00
Nicolas
32097fa29d Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-09-07 13:12:52 -03:00
Nicolas
5758af3291 Update website_params.ts 2024-09-07 13:12:46 -03:00
Nicolas
b3e2ca9a11
Merge pull request #638 from mendableai/nsc/removal-of-tags-in-include-main-content 
Removal of generic classnames/ids from onlyMainContent cleaning
 2024-09-07 13:06:43 -03:00
y5n
1ea9131e63 feat: Update redis deployment to run redis with password if REDIS_PASSWORD is configured 2024-09-07 16:00:32 +08:00
y5n
7685853d8a [Fix] fix SELF_HOST.md kubernetes cluster-install link 2024-09-07 13:50:47 +08:00
Nicolas
79870e7305 Update excludeTags.ts 2024-09-06 20:15:26 -03:00
Nicolas
a0f9ab2be7 Update map.ts 2024-09-06 20:14:47 -03:00
Nicolas
0731b3127d
Merge pull request #635 from shige/doc/update-self-host-v1.0.0 
[Docs] upgraded the path of the self-hosted documentation URL to `/v1`.
 2024-09-06 18:24:44 -03:00
Eric Ciarla
e89e6d89a8
Merge pull request #637 from mendableai/ETL-unicorn-example-app 
Add Docs to API Spec Example
 2024-09-06 15:28:41 -04:00
Eric Ciarla
2d245a35f2 Delete combined_api_spec.json 2024-09-06 15:27:58 -04:00
Eric Ciarla
2044e71fcf Docs to API Spec 2024-09-06 15:26:33 -04:00
Tadashi Shigeoka
aa2cf686f4 [Docs] upgraded the path of the self-hosted documentation URL to /v1. 2024-09-06 21:41:31 +09:00
Nicolas
f5b84e15e1 Update sitemap.ts 2024-09-05 17:52:27 -03:00
Nicolas
554a05068c
Merge pull request #629 from mendableai/go-parser-singleton 
Feat: parser singleton
v1.0.0 		2024-09-05 16:57:13 -03:00
Nicolas
4fa917f2b3
Update README.md 2024-09-05 16:45:23 -03:00
rafaelsideguide
82d6bf4ec8 feat(go-parser): singleton 2024-09-05 16:14:21 -03:00
Nicolas
b3f21d437b
Update README.md 2024-09-05 15:30:10 -03:00
Nicolas
cb630bfc34 Update fireEngine.ts 2024-09-05 14:24:10 -03:00
rafaelsideguide
8c1097e9e1 fix: pageOptions 2024-09-05 14:16:31 -03:00
rafaelsideguide
b301ffc922 added missing variables 2024-09-05 13:57:26 -03:00
Nicolas
a37ec6d17c Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-09-05 13:03:49 -03:00
Nicolas
c6f1d80992 Update crawl.ts 2024-09-05 13:03:43 -03:00
rafaelsideguide
7561bfe173 added envs to github action workflows 2024-09-05 12:59:32 -03:00
Nicolas
eb03a81152 Update crawl-status.ts 2024-09-05 12:55:04 -03:00
Sebastjan Prachovskij
503e83e83e
Add SearchApi to search 
Add support for engines, improve status code error

Remove changes in package, add engine to env params

Improve description in env example

Remove unnecessary empty line

Improve text
 2024-09-05 18:36:59 +03:00
Nicolas
f7461dac01
Merge pull request #608 from mendableai/feat/go-html-to-md-parser 
Feat: Added go html to md parser
 2024-09-05 12:32:03 -03:00
Nicolas
9ee7b19ca1 Merge branch 'feat/go-html-to-md-parser' of https://github.com/mendableai/firecrawl into feat/go-html-to-md-parser 2024-09-05 12:13:20 -03:00
Nicolas
34adf43200 Merge branch 'main' into feat/go-html-to-md-parser 2024-09-05 12:13:14 -03:00
Nicolas
82cb80c817 Update map.ts 2024-09-04 23:46:18 -03:00
rafaelsideguide
de9b9ef901 Merge remote-tracking branch 'origin/main' into feat/go-html-to-md-parser 2024-09-04 17:06:46 -03:00