The "Scan Floating IP" button failed with a client timeout: the project now holds ~6.4k floating IPs and the scan listed them all in one unpaginated, timeout-less Neutron request on the HTTP request context. openstack: ListFreeFloatingIPs reads marker-based pages (fields= keeps them small) with per-page retry/backoff on transport errors, 5xx and 429, and every request now has a timeout (also ends hangs inside the orchestrator tick). orchestrator: the scan is a single-flight background job on the process context with progress (clearing/listing/enqueuing/done/error), dry_run, full discovery before anything is enqueued, then SubmitIPs in chunks of 500 in ascending IP order; a failed read leaves the queue untouched. The auto-cycle gets a "scanning" phase that polls the job, so the control loop and autoCycleMu are never held across OpenStack/DB work; it recovers after a restart and waits for (instead of adopting) a scan started by someone else. db: migration 0009 (indexes), paged ListIPsPage/ListRegistryPage, GROUP BY counters, EXISTS completion check, set-based ClearAllIPs. API: POST /admin/ips/scan -> 202 (dry_run, wait), GET /admin/ips/scan, paging and filters on /admin/ips and /admin/registry (bare arrays without limit), results_by_overall in /admin/status. dashboard: scan progress panel and dry-run button, paginated /ips and /registry with server-side filters, Overview on counters and capped lists with progress/ETA, "select all N by filter", hx-params fix for per-row buttons, real counts in confirmations. Also: docs (API, USAGE, DASHBOARD, README), plan and review under docs/changes/, bin/ rebuilt with new SHA256SUMS. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
12 lines
544 B
SQL
12 lines
544 B
SQL
-- Scale indexes (see docs/changes: FIP scan at scale).
|
|
--
|
|
-- idx_ip_queue_registry: ListRegistry/ListRegistryPage look up the live
|
|
-- ip_queue row of every registry address by registry_id; without an index
|
|
-- that was a full scan per address, i.e. O(n^2) with thousands of addresses.
|
|
--
|
|
-- idx_ip_queue_state_aggregated: paged "recently finished" listings
|
|
-- (state filter, newest aggregated_at first).
|
|
|
|
CREATE INDEX idx_ip_queue_registry ON ip_queue(registry_id);
|
|
CREATE INDEX idx_ip_queue_state_aggregated ON ip_queue(state, aggregated_at);
|