2024-04-15 - KDB Project Call Meeting Minutes

[alvin-c-shih]

Date

Monday, April 15, 2024 - 9:30am ET / 2:30pm UK

// Second Monday of every month

Attendees

Fullname	Affiliation	GitHub Username
Alvin Shih	Morgan Stanley	@alvin-c-shih
Aaron Davies	Morgan Stanley	@adavies42
Rian Ó Cuinneagáin	KX Systems	@rianoc
Peter Gyorok	KX Systems	@gyorokpeter
Ross Duffy	Morgan Stanley	@rdffy

Meeting notices

• FINOS Project leads are responsible for observing the FINOS guidelines for running project meetings. Project maintainers can find additional resources in the FINOS Maintainers Cheatsheet.

• All participants in FINOS project meetings are subject to the LF Antitrust Policy, the FINOS Community Code of Conduct and all other FINOS policies.

• FINOS meetings involve participation by industry competitors, and it is the intention of FINOS and the Linux Foundation to conduct all of its activities in accordance with applicable antitrust and competition laws. It is therefore extremely important that attendees adhere to meeting agendas, and be aware of, and not participate in, any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws. Please contact [email protected] with any questions.

• FINOS project meetings may be recorded for use solely by the FINOS team for administration purposes. In very limited instances, and with explicit approval, recordings may be made more widely available.

Agenda

• (5 min) Convene, roll call, welcome new people.
• Display FINOS Antitrust Policy summary slide
• Review Meeting Notices (see above)
• (5 min) Approve previous meeting minutes.
  • Approved by acclamation.
• (10 min) "FD Technologies: Newry firm to be split into three companies" (bbc.com)
  • https://www.bbc.com/news/uk-northern-ireland-68444665
  • FD is purely consultancy.
  • KX is R&D.
  • Practice of giving kdb+ consultants an @kx.com ended a few years back.
• (5 min) qbinparse
  • Added support for arrays of unsigned int / short.
  • Will add support for missing features as they're reported.
• (5 min) Discuss synchronization of file writes between hosts.
  • Came up when a user was having q crash due to malformed sym file.
  • However, rare case since symfile updates are typically appends.
  • If more users report a need, can look into a locking daemon.
• (10 min) Peaching @ / . .
  • Probably don't want to peach primitives that are already multithreaded.
    • https://code.kx.com/q/releases/ChangesIn4.0/#multithreaded-primitives
    • q interpreter not likely to peer into a function to determine this.
  • Aaron provided a one-liner in the comments:
    • @[x;y;z] -> {@[x;y;:;z peach x y]}
    • x is data, y is index, z is function
• (10 min) AI SWE?! Implications for kdb / q?
  • https://www.cognition-labs.com/introducing-devin (watch the 2-minute video)
  • Microsoft AutoDev
    • https://arxiv.org/pdf/2403.08299.pdf
  • Some argue that q does away with much boilerplate code.
  • Data ingestion toil can be automated in more traditional means.
    • https://github.com/simongarland/csvguess
    • https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.read_csv.html
  • Maybe verbose.q could make it easier for an LLM to assist with coding tasks.
    • Initial commit for verbose.q #87
• (10 min) AOB, Q&A, Adjourn.
  • Some discussion about package repositories / module loaders.
  • https://kuki.ninja/ from Jo Shinonome is NPM-inspired.
  • pip install can compile C++ code as needed:
    • https://github.com/ggerganov/llama.cpp
  • \l doesn't work well with Windows where it's more common to have path with spaces.
    • PyKX team has wrappers that use Python helpers to expose functionality like \l that works with spaces.
  • kdb+ 4.1 has .Q.lo
    • https://code.kx.com/q/ref/dotq/#lo-load-without
  • There seems to be a -500!x internal function that may be related to AWS support.

Join Zoom Meeting

• https://zoom.us/j/94523415326?pwd=NkJDaUtUUlZTcHVwcUJHdG0yRFJUdz09
• Meeting ID: 945 2341 5326
• Passcode: 361990
• Find your local number: https://zoom.us/u/abTtYRZ0B6

[rianoc-kx]

@alvin-c-shih 15th correct? Today 8th is second Monday in April.

[alvin-c-shih]

2nd Monday is the usual day. Moving to next week since some can’t make it today. Regards, ACS From: rianoc-kx ***@***.***> Sent: Monday, April 8, 2024 9:20 AM To: finos/kdb ***@***.***> Cc: Shih, Alvin (Technology) ***@***.***>; Mention ***@***.***> Subject: [EXTERNAL] Re: [finos/kdb] 2024-08-15 - KDB Project Call Meeting Agenda (Issue #106) @alvin-c-shih<https://github.com/alvin-c-shih> 15th correct? Today 8th is second Monday in April. — Reply to this email directly, view it on GitHub<#106 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AE7MREOBERL7MABKGJKWRGTY4KKPHAVCNFSM6AAAAABF35UQQSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBSG42DCOBQGE>. You are receiving this because you were mentioned.Message ID: ***@***.***>

…

________________________________ Morgan Stanley is not acting as a municipal advisor and the opinions or views contained herein are not intended to be, and do not constitute, advice within the meaning of Section 975 of the Dodd-Frank Wall Street Reform and Consumer Protection Act. By communicating with Morgan Stanley you acknowledge that you have read, understand and consent, (where applicable), to the Morgan Stanley Privacy Policies https://www.morganstanley.com/privacy-pledge and General Disclaimers found at http://www.morganstanley.com/disclaimers/terms. The entire content of this email message and any files attached to it may be sensitive, confidential, subject to legal privilege and/or otherwise protected from disclosure.

[rianoc-kx]

Thanks - just clicked that issue title is 2024-08-15 which should be 2024-04-15.

[alvin-c-shih]

Fixed. Thanks! ACS From: rianoc-kx ***@***.***> Sent: Monday, April 8, 2024 9:28 AM To: finos/kdb ***@***.***> Cc: Shih, Alvin (Technology) ***@***.***>; Mention ***@***.***> Subject: [EXTERNAL] Re: [finos/kdb] 2024-08-15 - KDB Project Call Meeting Agenda (Issue #106) Thanks - just clicked that issue title is 2024-08-15 which should be 2024-04-15. — Reply to this email directly, view it on GitHub<#106 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AE7MRELWA4BXNGAHR7RPUFLY4KLMNAVCNFSM6AAAAABF35UQQSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBSG42TQOJWGI>. You are receiving this because you were mentioned.Message ID: ***@***.***>

…

________________________________ Morgan Stanley is not acting as a municipal advisor and the opinions or views contained herein are not intended to be, and do not constitute, advice within the meaning of Section 975 of the Dodd-Frank Wall Street Reform and Consumer Protection Act. By communicating with Morgan Stanley you acknowledge that you have read, understand and consent, (where applicable), to the Morgan Stanley Privacy Policies https://www.morganstanley.com/privacy-pledge and General Disclaimers found at http://www.morganstanley.com/disclaimers/terms. The entire content of this email message and any files attached to it may be sensitive, confidential, subject to legal privilege and/or otherwise protected from disclosure.

[gyorokpeter]

Péter Györök / KX

[rdffy]

Ross Duffy / Morgan Stanley

[rianoc-kx]

Rian Ó Cuinneagáin / KX

[adavies42]

Aaron Davies/Morgan Stanley

[adavies42]

@[x;y;z] -> {@[x;y;:;z peach x y]}

[rianoc-kx]

https://code.kx.com/q/ref/dotq/#def-parse-options

q).Q.def[`arg1`arg2`arg3!(0j;`;.z.D)].Q.opt .z.x
arg1| 1
arg2| `abc
arg3| 2024.04.10

From: https://stackoverflow.com/a/78305666/4256419

[alvin-c-shih]

Alvin Shih / Morgan Stanley