Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FIX] io_util: Detect utf-8-sig when using file utility #7006

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

ales-erjavec
Copy link
Contributor

Issue

Detect utf-8-sig when using file utility.

Fixes #7000

Note: An alternative would be to remove the use of file utility, chardet would recognize the BOM (and does so on windows where file is typically not available).

Description of changes

Detect utf-8-sig when using file utility.

Includes
  • Code changes
  • Tests
  • Documentation

Copy link

codecov bot commented Jan 27, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 88.48%. Comparing base (091e88c) to head (2df43bf).

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #7006   +/-   ##
=======================================
  Coverage   88.48%   88.48%           
=======================================
  Files         332      332           
  Lines       73333    73341    +8     
=======================================
+ Hits        64889    64897    +8     
  Misses       8444     8444           

@ales-erjavec ales-erjavec force-pushed the table-reader-utf-8-sig branch from 2fd00d0 to a714864 Compare January 29, 2025 09:07
@ales-erjavec ales-erjavec force-pushed the table-reader-utf-8-sig branch from a714864 to 2df43bf Compare January 29, 2025 09:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

CSV files containing BOM get that invisibly tacked onto first column name
1 participant