Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing data for bitcoin #4

Open
LeGabriel opened this issue Dec 13, 2019 · 13 comments
Open

Missing data for bitcoin #4

LeGabriel opened this issue Dec 13, 2019 · 13 comments

Comments

@LeGabriel
Copy link

Hi, it is a wonderful database,

But I believe that there is missing data for the bitcoin.

For these timestamps and period of missing data.

2014-11-22 00:03:00 - 40.039583 days
2015-05-01 05:59:00 - 30.834028 days
2016-04-01 02:00:00 - 61.000000 days
2016-08-02 20:02:00 - 7.910417 days

Is it normal ? is it just me ?

Thank you a lot for you database, it helps me a lot :)

@saleh-old
Copy link

I have my own gathering data, and I am missing data for these days too. It's on Market's side:

https://api-pub.bitfinex.com/v2/candles/trade:1m:tBTCUSD/hist?start=1416614400000&end=1416657540000&sort=1&limit=1440

returns empty:

[]

@LeGabriel
Copy link
Author

Thank you !
And is it absent on all market's sides ?

@saleh-old
Copy link

What do you mean by "all sides"?

@LeGabriel
Copy link
Author

sorry for my english it's not my mother tongue.
I was meaning, can we find the information anywhere else ?

@saleh-old
Copy link

No. We need to push their support team to look into it.

@im4kv
Copy link

im4kv commented Mar 4, 2020

@sullyfischer any updates on this issue?

@saleh-old
Copy link

saleh-old commented Mar 6, 2020 via email

@QuentinFAIDIDE
Copy link

Here you can see the proportion of holes in this dataset when aggregating the candles in bigger 15minutes ones. imgur link
The red bars are daily proportions of missing candles. When they reach the top, that means that 100% of the days candles are empty.
Clearly, if you take the data after July 2017 (1.510e12 timestamps), holes are small and it's acceptable, they never exceeds 25%.
However, you should be careful not to rely too much on pre-07/17 data, especially on BTCUSD, LTCUSD, or ETHUSD. I don't know if it's liquidity related of something else, but there are lots of days where there are no candles at all.
alt text

@saleh-old
Copy link

@QuentinFAIDIDE wow you went through a lot of trouble explaining it. thank you

@QuentinFAIDIDE
Copy link

@saleh-mir You're welcome, I needed this graph to select the most complete parts anyway, I just figured out it would be useful to you guys as I remembered there was an issue opened for the missing candles.

@saleh-old
Copy link

saleh-old commented Jun 28, 2020 via email

@gister9000
Copy link

@saleh-old
Does jessie framework have that feature now?

@saleh-mir
Copy link

@gister9000 yes. Now if you import candles for Bitfinex using it, it will use another driver (Coinbase) for those missing period and you don't have to deal with them

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants