This is a self enclosed wiki page containing the agenda and all the supplied review documentation. It is publicly viewable.
Post Meeting
We had a very successful meeting. We didn’t manage to squeeze everything we hoped for in the original planned meeting, but we covered all the key topics thoroughly, and learned a lot. We agreed to debate key decisions and follow-on actions at the Lasair telecon the following week. Key notes:
During the meeting, George kept some detailed notes.
After the meeting, Roy summarised some key questions
Then Andy added and amended: Andy’s version of key questions
Finally, in the Lasair meeting of Mar 25, we debated the key questions and edited the above wiki page to record conclusions and actions.
Update!
Because of the COVID-19 situation, this meeting is now being held online:
Join URL: https://zoom.us/j/294317035
Related Slack discussions https://app.slack.com/client/T4AL8RCP8/C0100SZJQMU
Rather than being spread over Tuesday and Wednesday, will now be 9-5 on Wednesday. Otherwise, the purpose and structure of the meeting is more or less unchanged.
Purpose and Goals of the Meeting
...
Identify the key technology decisions to make
Review the results of related tests and experiments
Conclude as many key technology choices as possible
Clarify remaining technology choices to be made
Set further tests in order to reach conclusions
Outline a technical design
Place/Date
ROE rooftop gallery. (See information on Visiting IfA)
The meeting is roughly one day spread over two.
Tues March 17th 11:00 -6:00pm
Wed March 18th 9:00am - 1:00pm
An informal pub dinner is planned for Tuesday evening.0900-1700 vis Zoom
https://zoom.us/j/294317035
Session-1: Introduction and Context
For general context, see papers O1-O6 below
Presentation slides will be uploaded on the day
Chair: George BeckettBob Mann
1109:00 Introduction and goals of meeting (Andy Lawrence) [slides PDF]
1109:10 Context: Rubin observatory, LSST and LSST:UK the construction schedule (Slides) (Stephen will add slidesSmartt)
1109:40 Lasair today: what it does, how it works – demo (Roy Williams)[see paper O5 and documentation] also add link to documentation
1210:10 Sherlock: what it does, how it works (Dave will add slides)
12Young) [slide deck]
10:40 Lasair planning process (Andy will add slides)Lawrence) [slides PDF][see also paper O2]
1311:00 Lunch Coffee break
Session-2 Discussion of Key Technology Areas
1411:00 30 Technology overview: what needs to be decided? (Roy Williams) [see Paper O1b]
14:20 Key area-1 discussion (led by?) [see details below]
15:10 Key area-2 discussion (led by?)
16:00 Tea break
16:20 Key area-3 discussion (led by?)
Tues evening: Pub dinner for those who wish
Session-3 Key Technologies review
09:30 Recap of Day-1 discussions
09:50 Debate the key technology decisions
10:30 Conclude as many as possible
11:00 coffee break
Session-4 Conclusions
11:20 Review remaining technology decisions
11:50 Set further evaluations needed to conclude these
12:30 Outline Technology Design
13:00 lunch
Key area issues
(Paper PDF)
11:50 Key Area-1 : Receiving and Processing the Data Flow (led by Stephen Smartt)
LSST public and private; galaxies, stars and rocks (Stephen Smartt) (
paperLasair ingestion with SSD (Ken Smith) (paper)(slides)
Handling light curves (Roy Williams) (
paperParallel ingestion and workflow (Roy Williams) (
paperStreaming queries (Gareth Francis)(Slides)
Making a super Sherlock (Ken Smith) (
paper)
12:40 lunch break
13:20 Key Area-2: Databases, Storage, Internal Structure (led by Ken)
MySQL vs Cassandra, query languages (Ken Smith) (paper)(slides)
Blob storage requirements and technology (Gareth) (
summary
14:10 Key Area-3: User services - querying, extraction, analysis (led by Roy)
Light curve classification and features (Michael) (
paperLasair and the LSST Science Platform (Stelios) (Slides)
15:00 tea break
Session-3 Key Technologies review (Stephen)
15:20 Recap of Day-1 discussions
15:40 Debate the key technology decisions
Session-4 Conclusions (Andy)
16:20 Conclude as many as possible
16:40 Review remaining technology decisions; set further evaluations
Discuss Outline Technology Design if time permits.
17:00 close
Key area issues
As we step through the presentations on the Key Areas, we should decide and record the key technology decisions needed, but will actually decide them in the next dayclosing session. Each discussion will have some presentations will to be made available on the day, but the technology evaluation reports should be available in advance.
...
Andy Lawrence [ROE]
Roy Williams [ROE]
Mark Holliman [ROE]
Ken Smith [Belfast]
Gareth Francis [EPCC]
Stelios Voutsinas [ROE]
Dave Morris [ROE]
Stephen Smartt [Belfast]
Michael Fulton [Belfast]
Dave Young [Belfast]
Nigel Hambly [ROE] after lunch
Teng Li [EPCC]
George Beckett [EPCC]
Terry Sloan [EPCC]
Bob Mann (definitely for 18th, probably for part of 17th) [ROE]
Britton Smith [ROE]
Meg Schwamb [Belfast]
Ally Hume [EPCC] Beginning of meeting only
Cam Allen ???
Joe Zuntz ??[Zooniverse] after lunch
Matt Nicholl [Birmingham/ROE]