16 Commits

Author SHA1 Message Date
Ademílson Tonato
41897139da
feat: enhance metadata extraction by including 'itemprop' attribute in HTML (#1624) 2025-06-03 18:16:46 +02:00
Gergő Móricz
8389a1a78d
fix(html-transformer): bad outName for og:locale:alternate (FIR-2101) (#1597)
* fix(html-transformer): bad outName for og:locale:alternate

* oops
2025-05-23 17:10:09 +02:00
devin-ai-integration[bot]
a5a915d639
Fix: Concatenate metadata arrays into strings with exceptions (#1574)
* Fix: Concatenate metadata arrays into strings except for ogLocaleAlternate

Co-Authored-By: Nicolas Camara <nicolascamara29@gmail.com>

* Fix: Only concatenate description field, preserve other metadata arrays

Co-Authored-By: Nicolas Camara <nicolascamara29@gmail.com>

* Fix: Only concatenate description field, keep other metadata fields in original format

Co-Authored-By: Nicolas Camara <nicolascamara29@gmail.com>

---------

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Nicolas Camara <nicolascamara29@gmail.com>
2025-05-20 12:40:53 -03:00
Gergő Móricz
2e2c3d52ce feat: add swoogo classes to force include main tags 2025-04-03 09:57:19 +02:00
Carter LaSalle
78094e2fe4
fix(html-transformer): Update free_string function parameter type (#1163)
Correct the parameter type to use libc::c_char for better type consistency
2025-02-11 15:11:29 +01:00
Gergő Móricz
892f3a41f3
fix(scrape): allow getting valid JSON via rawHtml (FIR-852) (#1138)
* fix(scrape): allow getting valid JSON via rawHtml

* fix(scrape/test):
2025-02-06 18:35:28 +01:00
Móricz Gergő
173028295b fix(crawl): relative URL page discovery issues 2025-01-28 09:41:37 +01:00
Gergő Móricz
8af4e4b8dd fix(html-transformer): preserve title tag 2025-01-27 16:13:24 +01:00
Gergő Móricz
4d8f4109b5 fix(rust): further select fixes 2025-01-25 18:48:40 +01:00
Nicolas
7fdecdc4d3 Nick: fixed include tags bug 2025-01-25 14:12:10 -03:00
Móricz Gergő
dacc5d4f45 fix(rust): improve 2025-01-25 12:59:14 +01:00
Móricz Gergő
4a1ab6f01c fix(rust): handle bad tok_1 2025-01-25 12:53:03 +01:00
Móricz Gergő
e8a6c1bb65 fix(rust): avoid panic always 2025-01-25 10:15:12 +01:00
Móricz Gergő
ce2c51f6c1 fix(rust): bad comp 2025-01-25 10:11:05 +01:00
Móricz Gergő
a2d94b525f feat: rewrite html transformer in rust 2025-01-25 09:41:33 +01:00
Gergő Móricz
b005450a34
port most of cheerio stuff to rust (#1089) 2025-01-24 22:04:54 +01:00