Twinkles Weekly: Thursday June 30, 2016

12 noon PDT, http://bluejeans.com/513427879

Present: Jim, Richard, Anders, Scott, Seth, Tom, Heather, Phil, Bryce, Tony

Apologies: Rahul, Michael

Check-in

How do you like the agenda, what are we missing?

No progress on Twinkles retreat, awaiting SLAC legal/financial. Hoping we don’t lose the booking...

Twinkles Reporting

Our next report is due next Friday: the LSST@SLAC presentation (July 8)

Strongly related, we also have the “Lessons from Twinkles” CI session in Oxford (July 21)

Other talks in Oxford? Bryce in SL? Rahul in SN? Computing tutorial?

Action: Phil to start Google slideset for Friday 8th, and iplemment structure suggested in discussion. Science intro, pathfinder infrastructure, science results, tutorial on how to get started playing with Twinkles data. Infrastructure called out for highlighting: workflow system and its throughput, distribution; software development framework (GitHub, travis, cookiecutter, code installations); tools: Pserve, Monitor.

Run 1.1 Light Curve Analysis

News from Bryce, Rahul and Jim - roadblocks? Goals for Oxford?

Bryce is adapting lensed AGN Rahul’s code for regenerating truth light curves given an input model: goal is results next week.

Jim is setting up to run SNCosmo on the forced source light curves: early results show low z SNe do have sensible estiamted SALT2 parameters.

Run 2 NERSC Test

As of 12:07 cori is still down :-( but is due to come back up today.

NERSC Installation

Cori is due to come back online today at noon Pacific, in the meantime, we have set up Edison with two versions of DMstack: w.2016.20 and 12_0
12_0 is a conda installation, please note that running the demo reported 2 failed quantities (only at NERSC):
https://community.lsst.org/t/two-failed-quantities-running-demo-for-12-0-at-nersc/894/2

The powers that be seem to agree that this is insignificant.

There is also a reported incompatibility with the 12_0 released sncosmo which has been fixed and will be added to the stack soon: https://github.com/sncosmo/sncosmo/issues/142

New High Performance Areas:


In response to our reported troubles with processing times, we have 2 new directories available to us for Python applications (such as DMstack):
/global/common/cori/contrib/lsst

/global/common/edison/contrib/lsst

These areas will have both 12_0 and w.2016.20 of DMstack installed soon.

Documentation

Phil and Heather made progress:

  • Getting started, epic at #207

    • Improving the landing / README #208 - Phil is making a better intro to the issues system, using sorting and the epics.

    • Better installation docs #160 - Heather is going to write notes for laptop and NERSC users, for Phil to alpha-test

  • Sphinx API docs for The Monitor Monitor/#33 - plan is to have travis deploy sphinx-generated html to the gh-pages branch, visible at http://darkenergysciencecollaboration.github.io/Monitor/

  • Weekly summaries #253 - initial plan is to export html from Google doc notes, and store in a suitable folder structure, then deploy to gh-pages so that we have a hyperlinked page to point people at. This would all be a precursor to setting up some simple blog system.

Issue 248: Image Differencing

Action: Simon to upgrade Cookbook with initial two calexp differencing

Action: Rahul to implement and run

Action: Jim to test as well, at NERSC?

Action: Simon to call in Ian and David to join in issue discussions

Any news?

RB: Not yet. I have been running part of the old cookbook which is now out of date.

Run 1.1 DM Validation Analysis

Action: MWV to investigate Run 1.1 drp_validation results

No news.