FfCsv2Cql

A simple transfer data from FileFlow/CSV to CQL (support Apache Cassandra, ScyllaDB, AstraDB). The implementation details:

• development as console application and NiFi processor/extension (support Java 17 and 21)
• support Apache Cassandra v4/v5, ScyllaDB, AstraDB based on CQL

The main motivations:

• support integration between Apache NiFi and Apache Cassandra
• the Apache NiFi 2 does not support Apache Cassandra v4/v5 (NiFi 2 deprecated support for Cassandra v3)

Current state:

• under development (unstable)

Supported conversions

The solution supports conversion from String to these CQL types:

• Boolean, TinyInt, SmallInt, Int, BigInt, Float, Double
• Date, Time, TimeStamp
• TimeUUID, UUID
• Text, varchar (by default)

Expected content/format

"colbigint","colint","coltext","colfloat","coldouble","coldate","coltime","coltimestamp","colboolean","coluuid","colsmallint","coltinyint","coltimeuuid","colvarchar"
"0","1064","zeVOKGnORq","627.6811","395.8522407512559","1971-11-12","03:37:15","2000-09-25T22:18:45Z","false","6080071f-4dd1-4ea5-b711-9ad0716e242a","8966","55","f45e58f5-c3b7-11ef-8d19-97ae87be7c54","Tzxsw"
"1","1709","7By0z5QEXh","652.03955","326.9081263857284","2013-12-17","08:43:09","2010-04-27T07:02:27Z","false","7d511666-2f81-41c4-9d5c-a5fa87f7d1c3","24399","38","f45e8006-c3b7-11ef-8d19-172ff8d0d752","exAbN"
"2","6249","UYI6AgkcBt","939.01556","373.48559413289485","1980-11-05","15:44:43","2023-11-24T05:59:12Z","false","dbd35d1b-38d0-49a4-8069-9efd68314dc5","6918","72","f45e8007-c3b7-11ef-8d19-d784fa8af8e3","IjnDb"
"3","6998","lXQ69C5HOZ","715.1224","236.7994939033784","1992-02-01","08:07:34","1998-04-09T23:19:18Z","true","84a7395c-94fd-43f5-84c6-4152f0407e93","22123","39","f45e8008-c3b7-11ef-8d19-0376318d55df","jyZo8"
...

• CQL DATE
  • ISO_LOCAL_DATE (format "yyyy-MM-dd"), example '2013-12-17'
• CQL TIME
  • ISO_LOCAL_TIME (format "HH:mm:ss"), example '08:43:09'
• CQL TIMESTAMP
  • ISO 8601 (format "yyyy-MM-dd'T'HH:mm:ss'Z'"), example '2001-01-01T00:00:00Z'