astrophotography/state/TODO.md
laurence 59d6e30712 Make the merged repository coherent: README, state, and internal links
The mechanical merge preserved both histories but left two repositories
sitting side by side rather than one repository. This is the part that
makes it whole.

A top-level README explains the three strands - the telescope network
and campaign, the processing code, and in-person observing plans - and
says plainly that image data does not live here, because that is the
first question anyone will have when they find a pipeline with no
pixels.

state/PROJECT.md was still describing a markdown-only reference project
whose scope explicitly EXCLUDED automating bookings and image
processing. Both of those are now most of what the project does, so the
objective, scope and key facts are rewritten to match reality.

state/DECISIONS.md records why the merge happened - the two repos were
split by chronology rather than design, and the seam was already
leaking, with the campaign's TODO citing results held in the other repo
and the pipeline's README explaining a campaign it did not contain. It
also records that the image data deliberately stays out of the
repository.

state/TODO.md gains the pipeline and observing work that previously had
nowhere to live, including the measurement that changes the pipeline
plan: per-frame processing is 2.9 seconds and the whole 24-frame session
is 1.1 minutes single-threaded, so a scheduler earns nothing on stacking
and should be pointed at the Monte Carlo stages instead.

Internal links fixed for the new paths: pipeline/README.md referred to
session-scripts/ throughout, and itelescope/README.md pointed at a
state/ directory that is now one level up.

The .gitignore conflict between the two repositories is resolved by
combining them, with image formats ignored globally except under docs/,
where documentation figures are committed deliberately.
2026-07-21 17:16:20 +01:00

121 lines
6.9 KiB
Markdown

# TODO
> The current state of play. Keep it honest and current; this is what the next session
> reads to know what to do. Move items between sections as they progress.
## Done
- 2026-07-17: repo created on git.discworld.casa, Default Workflow scaffold copied in.
- 2026-07-17: specs sheet snapshotted to data/itelescope-telescopes.csv (24 scopes).
- 2026-07-17: TELESCOPES.md written: per-scope reviews for all 23 active telescopes
plus a choosing guide (T74 noted as in commissioning, no specs published).
- 2026-07-18: TARGETS.md written: southern targets invisible from the UK (dec tiers
from lat 51.5°N), matched to Q62/X07 scopes, seasonal booking calendar, and a
July-August starter campaign (T33 free, T71 narrowband, T73 galaxy, T8 LMC later).
## Done (recent)
- 2026-07-20: NGC 6744 on T59 SUCCEEDED (reservation 749227, txn 851148): full
LRGB dataset on the scope server (L 15x300s BIN1, RGB 7x300s each BIN2),
previews verified clean. Billed 381 pts (est was ~240: see the rate
correction in NOTES.md). Balance now 2,257. Ledger updated in CAMPAIGN.md.
## Done (recent)
- 2026-07-21 ~08:55 UTC: free T33 47 Tuc retry booked as reservation 749314
(grid-verified), third attempt at the first-light test, runs 14:05-14:50 UTC
21 Jul, costs 0.
## Done (recent)
- 2026-07-21 11:40 UTC: Cen A on T32 verified COMPLETE (billed 160, NGC5128
images on the scope server), and queue #2 (Corona Australis on T8) booked for
the night of 22 Jul, 21:45-00:45 SSO local, which brackets the target's
culmination instead of chasing it down the western sky. Rate model rebuilt
from two actual bills. Details in the CAMPAIGN.md session note.
## In progress
- T33 first-light test on its THIRD booking (749314), which had NOT yet run as of
11:40 UTC 21 Jul: it starts 14:05 UTC. Verify after 14:50 UTC (images and logs
on t33.itelescope.net:8033 were still empty/stale at 11:40, as expected). The
two prior free reservations (749228, 749229) expired unused with reschedule=No;
if 749314 also fails to run, stop rebooking and either walk it in (POST
plan.asp per plans/README.md) or drop the free objective.
- The T32 HDR core set (plans/hdrcore-t32.txt) was booked and then CANCELLED on
2026-07-21 without running: the Cen A nucleus is not saturated, the earlier
claim having measured a foreground star. See the correction in CAMPAIGN.md.
Zero points spent. The plan file remains available on T32 if a genuinely
saturated target turns up.
- The 21 Jul Cen A data has been fully processed off-repo, in the user's
Downloads\NGC5128\20260721\stacked folder: masters, plate solution (0.27
arcsec on 237 stars), an LRGB composite, a globular cluster survey (289
candidates, 62% catalogue-confirmed, density falling 10.5x outward), surface
photometry (Sersic n = 4.27, Re = 400 arcsec, total G = 6.56, which matches
the catalogued brightness and so validates the photometric chain), and a
transient/moving-object search (both null, with measured limits). METHODS.md
there documents the lot. Nothing from that analysis needs to come back into
this repo, but two results affect FUTURE sessions and are recorded here:
**(a)** measure saturation properly before buying short subs, and **(b)** the
faint outer halo in that stack is limited by the sky-plane subtraction
(-17.9 ADU/px of real halo light absorbed), not by exposure time, so more
integration alone would not have gone deeper.
- CrA on T8 runs 11:45-14:45 UTC 22 Jul. Verify after 14:45 UTC: images under
/images/qisback/T8/ on t8.itelescope.net:8008, then the actual bill from
account/history.aspx into the ledger. This is the first T8 bill, so it also
fixes T8's effective rate (card says 130/hr; trust nothing until observed).
- DRAIN CAMPAIGN ACTIVE (see CAMPAIGN.md): spend the full balance by 10 Aug,
then cancel before the 12 Aug renewal (user confirmation required for the
cancel itself). 541 of 2,638 spent; 2,097 remain. The x1.6 estimate multiplier
is WITHDRAWN: billing is on plan imaging minutes, and per-scope rates must come
from actual bills (T59 127/hr, T32 80/hr observed; the NOTES rate card is
unreliable). On current numbers the campaign UNDER-spends by ~800: plan extra
or longer runs, do not trim. Reschedule flag never sticks (grid always shows
No): treat every reservation as one-shot and verify the morning after.
Download the NGC 6744 and NGC 5128 data from data.itelescope.net before the
10 Aug cancellation sweep. Update the CAMPAIGN.md ledger after every session
from account/history.aspx.
## Pending - pipeline
- Productionise the processing code: a staged CLI
(ingest -> calibrate -> measure -> register -> stack -> solve -> compose ->
analyse), each stage resumable, packaged as an Apptainer image. Slurm array
jobs afterwards and ONLY for the expensive stages: measured on the NGC 5128
session, per-frame work is 2.9 s and all 24 frames take 1.1 min
single-threaded, so a scheduler buys nothing there. It pays for the Monte
Carlo work (completeness and injection-recovery tests, difference imaging,
shift-and-stack), which is where compute actually bit.
- Must handle beyond mono LRGB: narrowband palettes, one-shot colour with
debayering, other observatories' header conventions, and full calibration
from bias/dark/flat for sources that do not pre-calibrate.
- Three findings from the first session are requirements, not options: vet
moving objects in DETECTOR coordinates; carry r50/psf into any catalogue
cross-match; never fit a sky background to a field the target fills.
## Pending - observing
- Total solar eclipse, 12 Aug 2026, Menorca (`observing/eclipse-2026-menorca/`).
Totality 1m12s at Ciutadella with the Sun at 2 degrees, azimuth 288.
**Order the certified solar filter - it is the only item with no substitute
and there are three weeks left.** Then practise on a low sunset to calibrate
exposures for the extreme atmospheric extinction.
## Pending - iTelescope
- Automation: map the ACP web endpoints on a per-scope server (start with free
T33) for plan submission and status; explore lookup.itelescope.online (the new
planner); enumerate more /DataService.svc methods. Recon notes in NOTES.md.
- Campaign impact (status seen 2026-07-18): T71 and T73 are offline
(development/mount testing), as are T2, T17, T18, T20, T25, T30, T72, T74,
T75, T80. T8, T33, T32, T59 at Siding Spring are operational. Re-plan the
July-August campaign around T33 free time and Siding Spring scopes until the
Chile rebuild finishes; re-check status before any booking.
- Fill in T74 when iTelescope publishes its specs.
- Reconcile the retired scopes (T9, T19, T31, T69): the support article still lists
them but the maintained sheet does not; confirm status and note it.
- Optional: per-telescope detail pages on support.itelescope.net (links in
DECISIONS.md) hold photos and operational history if deeper entries are ever wanted.
- Periodic refresh: re-export the Google Sheet and diff against data/ to catch new or
changed systems.