Electronics Action Items

Telemetry database backup?

Sept 2: Not backed up anywhere. SG to ask BJ if he is mirroring database? Grafana can then pull from local database?

System puts data in database and plain text file. But on same computer. RAID but also on same computer.

GitHub? Code backups?

Sept 2: Backed up via official Keck software way of backing up - on the Keck repository (svn (sub-version)).

Will: we should start doing ordinary backups of kpf-prime. Will to put system config files into repository. SG: get set up on backup drive at SSL? If not…document what we do and put in repository; 2nd sync to kpf-asl-backup.

KTL keyword for NTP health status

set up emir alarms for KPF

might be called ‘kpfmon’

Make telemetry database read-only

Safeguard against accidental changes

Observing modes spreadsheet

revisit in earnest in August

Finalize ethernet layout diagram

Add webcam in crypt going to ops network; answer computer port questions

Open

Configuration control

May be possible with config files (one per mode) and a small application to set the keywords, and do comparisons to show which mode is active.

Check power cycling sensitivity of each device

SG to add this ‘checkbox’ to the wiki somewhere.

note Leybold webserver clock/battery issue

Check each device to ensure front panels can be locked out

Vac gauge spreadsheets not on wiki

SG in progress

webKTL interface for Instec

Sept 2: PID file upload still to be added.

Look into intercepting javascript packets from pump controller webserver

Sept 2: all done and working.

Aug 5: Will attempting to use Google ‘Puppeteer’ node.js package, but having trouble with required css and javascript files being locked out for security reasons

July 9: Will has started on decoding ‘message’ to send to pump, but has not had a chance to try it out yet.

June 17: looking into it, but reliability of intercepting javascript packets a concern

Steve to check connectors on pump - more than one serial connector? - Yes - USB can connect between pump and webserver, frees up RS485 port.

Decided at June 11 meeting that custom, serial-based pump control software unnecessary and we’ll use the turbo.control webserver interface for control of pump if needed for maintenance. We will try to decode javascript packets to pull telemetry values from them.

LinkHub dispatcher

Sept 2: Done and running!

kpfpower fixes

Sept 2: all dispatchers up and running and claiming to talk to PDUs

Need to decide how to name each outlet.

There is ability to lock an outlet - likely want to enable that for things like switches and computers. Easy to add, just need to decide and do it. Brad will think about timing lock openings so they close after a set time.

Ion Pump wiki page

Ca HK detector wiki page

Finalize Lakeshore sensor names/locations

Steve to provide Brad with final sensor name/location list. Brad can then update sensor config file and re-compile.

LinkHub-E web wiki page set up by Steve and ready for dispatcher development.

Medium Precision Temperature Sensors

Look into connecting to CCD Cold Head Temperature Controllers (for telemetry only as a start)

Dispatcher done.

Aug 5: service running (telemetry for KPF Green), engineering modes still to do

July 9: troubles with uploading cal table (can download and parse). Instead of uploading file at start up, decided to download current cal table, compare to expected table, ensure they are the same. If different complain in some way through alarms.

June 17: Brad has established ethernet communication and working on combining dispatcher into service with Vaisala and Lakeshore

Discussed at June 10, 2021 meeting

LFC (and etalon) will be on ops network (for vendor remote access). Is that OK for KTL since not on KPF private network? And also for the KPF telemetry database? Would dispatchers have to be installed somewhere other than on kpf-asl-prime?

Sept. 2: our software can talk to computers on any computer at Keck so OK.

extra Lantronix on vac cart now that pump dispatcher is not using RS-485

Sept 2: DONE

Unique observation ID

Placeholder reminder about choosing its format. Can this just be an integer that counts up?

September 2 - decided to start with integer approach and see how it works. Won’t go into filename, but rather be a FITS keyword value.

Steve to ask Arpita to make sure there are no red flags (like too many digits after many many obs)

KTL config connection to wiki PDU outlet page

September 1, 2021

Sept. 2 - seeming too fragile. Will to have one last look. - Abandoned

Adapt Keck Lakeshore service for KPF

Aug 5: dispatcher running, broadcasting to telemetry database

Done aside from a future update of sensor names in a config file.

July 9: Steve to find a sensor to connect to verify reading temperatures (currently showing -273.15

June 17, in progress. Not adapting Keck but linking in Vaisala & Instec into same service.

Agitator parameters (speed, motor torque limits for safety) to be fine-tuned with Martin Sirk’s help in the lab at SSL.

Aug 5 - done! Will traveled to SSL to fine-tune with Martin.

Log file on kpf-asl-prime

Aug 5: decided OK as it operates now (Keck will do something different anyway). Done!

• I could not persuade selinux (Security-Enhanced Linux) to allow rsyslog to write to our standard log locations $KROOT/var/log/.  I will have to ask Steve Allen to assist with sorting that out.

• Temporarily, I have left the computer in “Permissive” mode [ie, selinux is not enforcing its strict security rules] so that rsyslog can write to the Kroot directory.

webKTL installation

Aug 5: Done! Agitator now can be run from webKTL

July 9: Will will focus on setting up for agitator

Will allow us to monitor and control our devices

Agitator run instructions (superceded by webKTL interface?)

Aug 5: Done! Now controllable form webKTL (what we will use going forward)

After I finish the reconfig, the command line use will be:

To Start: put it into jog mode, and set speed:

modify -s kpfmot agitmod=jog   agitspd=1000   (or whatever)

<do something to home, gotta think about this, because we don’t actually care about a home>

To Stop:

modify -s kpfmot agitmod=halt

What’s missing from the above: we don’t have a definition of 'homing', but the software requires being homed.  Let’s discuss tomorrow.

Caution: initially, don’t command motion w/o being present, to confirm that it’s moving smoothly and not vibrating.

Talk to BJ Fulton about best way to export KPF telemetry data

Aug 5: done!

July 9: met with BJ. Steve has requested access through SSL firewall. BJ will send Will login details for kpf-asl-prime. BJ will then connect and start setting up Grafana, adding device plots as devices become available.

July 9: Vaisala up and running. Steve to set up meeting with BJ, Will, Brad and Steve

BJ setting up grafana interface for viewing telemetry stream

• June 11: talk to Steve Allen about this, and also Keck

Will and Brad to chat about their keywords

Finalize CCD Cold Head Temperature Controllers device page

June 23: wiki page ready for software development

June 17: Still in progress, working on engineering modes now.

Steve to re-upload cal table 1 to ensure it’s not corrupt - DONE

June 11: Steve working on command list

Send Vaisala, Intensity Monitor to SSL

Decided at June 11 meeting

Send Eaton PDU to SSL?

Decided at June 11 meeting

Send back 3rd NUC

Decided at June 11 meeting

Finish service for Leybold Graphix II gauge controller

July 13: finished; ready for use.

Add Aux rack to diagram here:
SSL Network Details

Invite Josh and Kyle to meeting every other week; change time to Thursday afternoons

Want to keep them in the loop

kpf-asl-prime package installation

• Steve did a bare-bones CentOS 8.3 install (adding GNOME and cmd line/GUI RAID software). Goal was to do minimum to get it running and on network.

• Different than kpf-server which was built up at UCSC

• June 11: Agreed to just add packages as needed ( and track them).

Discuss vacuum pump control and telemetry with Will and Brad

Vacuum pump webserver summary page

SBIG SDK discussion

• SDK:

https://cdn.diffractionlimited.com/dlapi/md_quickstart.html

• Brad’s note about shorter MTBF

• I noticed this line:

“Note: This API does not support legacy SBIG ST-, STL-, STX-, STXL- and similar cameras supported by the SBIGUDrv.”

Discuss prioritizing Instec telemetry

Currently not in use with cryostat, but will be in a couple/few weeks.

Discussed at June 10 meeting

Tell Brad webcam usr/pwd

Now on SSL network, should be accessible from kpf-asl-prime

KFP history (telemetry) on kpf-asl-prime

• The kpf history (telemetry) service is installed and running.  But it needs additional services added to its configuration; currently it’s monitoring just kpfpower and kpfmot.

kpfmot consolidation

• The kpfmot service now incorporates all motion-control components: currently it contains the agitator controls, the source shutter controls, and the thorlabs filterwheel control.

set up kpf-asl-prime as our main server

• kpf-asl-prime is more-or-less ready to do all its functions as instrument server.

• The daemons that Brad created for kpf-server, are now installed on kpf-asl-prime.

• Both of the KPF servers know where these services run — that is, you should be able to do a “gshow -s servicename …” and be able to monitor keywords from anywhere.

• The KPF master start/stop script knows about the history service, the Galil’s, and the filterwheel