Fix table parser issue. (#5482)

### What problem does this PR solve?

#1475
### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
This commit is contained in:
Kevin Hu 2025-02-28 16:09:12 +08:00 committed by GitHub
parent fe1c48178e
commit b418ce5643
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -223,7 +223,7 @@ def chunk(filename, binary=None, from_page=0, to_page=10000000000,
continue continue
if not str(row[clmns[j]]): if not str(row[clmns[j]]):
continue continue
if pd.isna(row[clmns[j]]): if not isinstance(row[clmns[j]], pd.Series) and pd.isna(row[clmns[j]]):
continue continue
fld = clmns_map[j][0] fld = clmns_map[j][0]
d[fld] = row[clmns[j]] if clmn_tys[j] != "text" else rag_tokenizer.tokenize( d[fld] = row[clmns[j]] if clmn_tys[j] != "text" else rag_tokenizer.tokenize(