2729 Commits

Author	SHA1	Message	Date
Nicolas	0bff5b1a24	Update auth.ts	2024-10-11 15:29:25 -03:00
Nicolas	257a951132	Update auth.ts	2024-10-11 14:21:04 -03:00
rafaelsideguide	e916ea7e1a	updated openapi.json	2024-10-11 13:55:15 -03:00
rafaelsideguide	e57a8e9d45	better explain how includePaths and excludePaths work	2024-10-11 13:52:18 -03:00
rafaelsideguide	c1f98d0371	fixed developer.notion special case	2024-10-11 10:54:59 -03:00
rafaelsideguide	8cbd94ed2d	fix/filters failed and unknown jobs now	2024-10-11 09:45:51 -03:00
Nicolas	bfed65d443	Update package.json	2024-10-10 17:46:49 -03:00
Nicolas	2cde877342	Nick: version bump	2024-10-10 17:44:27 -03:00
Nicolas	4960b2b0c2	Merge branch 'main' into feat-sdks/cancel-crawl	2024-10-10 17:43:20 -03:00
rafaelsideguide	2689ffa748	feat-sdk/cancel-crawl	2024-10-10 17:08:08 -03:00
rafaelsideguide	68a4c2e402	Fixed missing error handling in JS-SDK	2024-10-10 16:29:35 -03:00
rafaelsideguide	f113222829	fix: removing test teams concurrency limit	2024-10-10 09:46:25 -03:00
busaud	0934dd88d3	Update README.md ... I believe wait_until_done was removed as of v1?	2024-10-10 09:35:12 +03:00
Nicolas	d410804348	Merge pull request #755 from busaud/main ... bugfix: self-host crawling doesnt respect limit	2024-10-09 22:56:44 -03:00
Nicolas	abb5ec7439	Update playwright.ts	2024-10-09 22:55:01 -03:00
Nicolas	f6ec45f046	Merge pull request #747 from Harsh0707005/timeout-parameter-not-passed ... Fixed Issue #734	2024-10-09 22:53:26 -03:00
Nicolas	222a34cae8	Update playwright.ts	2024-10-09 22:53:03 -03:00
busaud	c6ebbc6f6a	bugfix: self-host crawling doesnt respect limit	2024-10-09 22:52:49 +00:00
Nicolas	52ec43aac3	Update index.ts	2024-10-09 19:42:25 -03:00
Nicolas	5ff6c64d77	Update index.ts	2024-10-09 19:30:14 -03:00
Gergő Móricz	17d0ed061e	push	2024-10-09 23:13:26 +02:00
Gergő Móricz	b2ae1a52d5	fix(Dockerfile): remove chromium	2024-10-09 23:13:13 +02:00
Gergő Móricz	2d365ebc6d	fix(redis): protected mode off	2024-10-09 22:09:08 +02:00
busaud	237442fabb	Make sure the entrypoint script has the correct line endings	2024-10-09 20:58:37 +02:00
rafaelsideguide	ae464ada60	tests: teamIds	2024-10-09 15:06:29 -03:00
Nicolas	1cd49a0a95	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-10-09 14:41:25 -03:00
Nicolas	064ce482c2	Update blocklist.ts	2024-10-09 14:41:23 -03:00
rafaelsideguide	4020a7d781	test: added test suite tokens	2024-10-08 15:11:08 -03:00
Gergő Móricz	075b63b57b	feat(redis): add memory calcualtion when not running on fly	2024-10-08 17:03:37 +02:00
Harsh Master	aa3d4b8d6c	Fixed Issue #734	2024-10-08 11:36:12 +05:30
Nicolas	5c0c952a27	Update website_params.ts	2024-10-07 14:51:05 -03:00
Nicolas	1f1afeaac4	Update system-monitor.ts	2024-10-04 15:15:04 -03:00
Nicolas	dba96998e3	Update fetch.ts	2024-10-03 18:56:51 -03:00
Nicolas	668ff3c71b	Update fetch.ts	2024-10-03 18:55:39 -03:00
Nicolas	25dd16bf2a	Nick: removed 401	2024-10-03 18:52:17 -03:00
Nicolas	93657f6a44	Update queue-worker.ts	2024-10-03 18:44:40 -03:00
Thomas Kosmas	28b64fc704	Change the gracefull shutdown signal	2024-10-04 00:40:09 +03:00
Nicolas	497ac3328b	Merge pull request #732 from mendableai/fix/url-validation-params ... [BUG] Fixed URLs with params	2024-10-03 17:43:37 -03:00
rafaelsideguide	cfd776a5de	fix: now urls with params are passing validation ... example: https://www.granitecreek.com?asljhda=akjshd	2024-10-03 17:37:04 -03:00
Nicolas	99ca852e5d	Merge pull request #731 from mendableai/nsc/crawl-fixes ... Fixes crawl failed and webhooks not working properly	2024-10-03 17:37:03 -03:00
Nicolas	85e9f7b9b9	Merge pull request #727 from mendableai/nsc/error-js-sdk-improv ... Improves error handler in Node SDK to return the status code	2024-10-03 17:36:31 -03:00
Nicolas	4f7608821f	Update package.json	2024-10-03 17:36:20 -03:00
Nicolas	f743f2b922	Update index.ts	2024-10-03 17:34:29 -03:00
Nicolas	c6a29efbed	Update crawl-status.ts	2024-10-03 17:33:38 -03:00
Nicolas	ddd774ed68	Nick:	2024-10-03 17:20:57 -03:00
Nicolas	82551bb6bc	Update index.test.ts	2024-10-03 17:13:30 -03:00
Nicolas	49bd95327e	Update types.ts	2024-10-03 17:00:33 -03:00
Nicolas	1a1ac9fd60	Nick:	2024-10-03 16:37:58 -03:00
Nicolas	a150aa820c	Nick: shouldnt fallback on a 400 + error code should be correct on page status code	2024-10-03 15:21:42 -03:00
Nicolas	489a643391	Update index.ts	2024-10-02 20:25:52 -03:00