Attendees: Russell, Nicole, Ani, Maria, Sergei, Kem, Jacek
Intro: logging to lsst EA server, "get all latest"...
UML - skunk meeting
===================
Primary focus on usecase (see in EA):
use cases --> app --> image processing
--> process pixels --> select and apply flatfield
Explained the new model: processing stages, processing slices.
See in EA:
use cases --> middleware --> Pipeline Execution
--> Processing Step Sandbox
(including the diagrams inside)
See reworked flatfield use case:
use cases --> app --> image processing
--> process pixels sandbox --> process pixels diagram
Explained:
- use case generalization
- issue of synchronization between Processing Stages
- need to clean up the whole model
Skunk work: planning to work on second use case (name...?)
which will touch much more on database/ingest aspects
- planning to hijack next DataAccess, Database and Data Mgmt
telecons to finish skunk work
- goal: to identify interfaces (under Middleware API)
UML - Data Ingest
=================
Reworking Catalog Data Ingest at Base Camp use case
- work started after the skunk meeting (last 2 1/2 days)
- based on what was discussed at the skunk meeting
(Slices, Stages, policy files) and the original use case
we had in uml
- 2 sections:
a) Data Ingest Converter (3 use cases, planning to introduce
one higher level for all 3, EA permission issues)
b) Ingest Service
- changes relative to the old use case
- introduced temp table to verify if data 'sane'
- introduced process that verifies if table not locked
by readers for too long
- linked start/shutdown with Slices/Pipeline execution
- added configurations through Policies
- have robustness diagrams
- have some sequence diagrams, but still rusty
- have interface objects with attributes and functions
under Middleware API
- need to finish sequence diagrams, clean up, de-bug
Look at
- use cases - middleware - data ingest - new_...
and
- logical view - domain model - middleware api
For Tables (Ingest and Temp) see their properties - links,
do not have functions/attributes (yet), not sure how to model
schema
=======
- Jim Gray tried to port Sergei's schema to sql server,
after fixing a couple of problems it is working now
- replaced geometry types with HTM
- Jim's version does not have geometry package
- temporary solution
- Sergei needs to rename tables (add "Provenance" word)
- then ready to put in EA
- Sergei/Kem don't have full EA (due to budget constraints)
- Nicole will try to insert Sergei's schema into EA
AOB
===
Not sure when the next telecon is, might need to use
our slot for Skunk-meeting discussions
Jacek
Becla, Jacek wrote:
Keywords: DataAccWG
Hi,
Reminder: we have the Database telecon
tomorrow (Wednesday) at 11:00 PST.
Phone number: 866 330 1200
passcode: 300 2363
Agenda:
- schema
- UML: Catalog Ingest at Base Camp
Jacek
_______________________________________________
LSST-data mailing list
[email protected]
http://www.lsstmail.org/mailman/listinfo/lsst-data
_______________________________________________
LSST-data mailing list
[email protected]
http://www.lsstmail.org/mailman/listinfo/lsst-data
