Lasair Tech Review: Roy's key questions

Here is Roy’s list of required decisions immediately following the meeting:

• Query language

  • Nature of user query mechanism, free SQL or Vizier-type form?

  • Do we build queries in KSQL?

  • If so, do we also keep the close connection between static and streaming queries?

• Relational database

  • Are light curves in there? What about forced phot?

  • Is there just one RDBMS or several?

  • Mysql/postgres or some noSQL eg Cassandra?

• Hardware

  • Can we get openstack nodes with ssd? How many, how much?

• Watchlists and user data

  • Measure scalability of watchlists.

  • How easy to add a new catalog to sherlock?

• Kafka Inside or not

  • Can somebody make a prototype data ingestion that has Kafka inside?

• Blob storage

  • Are images in there? Or just the whole AVRO packet as received?

  • Blob store implmentation as CephFS or SWIFT or Cassandra?