[CON-307] Should gracefully ignore binary files encountered during indexing

[sestinj]

Before submitting your bug report

• I believe this is a bug. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that reports the same bug
• I've seen the troubleshooting guide on the Continue Docs

Relevant environment info

- OS:*
- Continue version:*
- IDE version:*

Description

Right now Continue maintains a long list of file extensions to ignore by default during indexing, but on top of this it would be best if we could just gracefully ignore such files.

Probably either detect when reading the file and then skip, or just convert binary to UTF-8 before processing

To reproduce

No response

Log output

No response

_CON-307