Re: [ldm-users] Stumped by PIPE action

Thanks for the quick reply Mike.

pqactcheck returns "syntactically correct"

I've restarted LDM a couple of times this week in the process of trying to
figure this out. We use a systemd script for stopping/starting that
recreates the queue on start, so the queue is fresh. This machine (AWS
instance, actually) has 16 CPU cores and 64 GB of RAM. RAM, CPU usage and
disk space all look normal.

I've administered LDMs for many years, and I've never had a pqact issue
stump me like this one.

Matt


On Thu, Apr 23, 2026 at 12:49 PM Mike Zuranski <mike@xxxxxxxxxxxxxxxxxxx>
wrote:

> Hi Matt,
>
> Some basic troubleshooting questions:
>
> Does ldmadmin pqactcheck show any errors?  When was the last time LDM was
> restarted or the PQ remade?  Does the health of your system (e.g. disk
> space, memory, cpu) appear normal?
>
> -Mike
>
> On Thu, Apr 23, 2026 at 1:44 PM Matthew Foster - NOAA Affiliate <
> matthew.foster@xxxxxxxx> wrote:
>
>> I have a PIPE action in our pqact.conf that was working...until it
>> stopped. I can't figure out what changed. Putting pqact in DEBUG yielded
>> the following log messages...
>>
>> 20260423T171759.226677Z pqact[3286699]
>>  palt.c:processProduct:1332          INFO  928481a80643522717d70b2fa139c28e
>>   35526969 20260423171755.509410 NOTHER 1130006  TICY70 KNES 231707
>> 20260423T171759.226808Z pqact[3286699]
>>  palt.c:prodAction:1217              DEBUG pipe: {cmd: "-close
>> /usr/local/ldm/agents/storeAndIngestFile.py
>> /data_store/polar/20260423/17/TICY70_KNES_23170
>> 7_1130006.2026042317 TICX99", ident: "TICY70 KNES 231707"}
>> 20260423T171759.227206Z pqact[3286699]
>>  filel.c:pipe_open:1854              DEBUG 6 3295768
>> 20260423T171759.227247Z pqact[3286699]
>>  filel.c:pipe_prodput:2174           DEBUG 6 TICY70 KNES 231707
>> 20260423T171759.227414Z pqact[3295768]
>>  filel.c:pipe_open:1819              INFO  Executing decoder
>> "/usr/local/ldm/agents/storeAndIngestFile.py"
>> 20260423T171759.292967Z pqact[3286699]
>>  filel.c:fl_removeAndFree:421        DEBUG Deleting failed PIPE entry:
>> cmd="-close /usr/local/ldm/agents/storeAndIngestFile.py
>> /data_store/polar/20260423/
>> 17/TICY70_KNES_231707_1130006.2026042317 TICX99", pid=3295768
>> 20260423T171759.293001Z pqact[3286699]
>>  filel.c:pipe_close:1901             DEBUG 6, 3295768
>> 20260423T171759.293050Z pqact[3286699]              pbuf.c:pbuf_flush:111
>>               ERROR Broken pipe
>> 20260423T171759.293070Z pqact[3286699]              pbuf.c:pbuf_flush:111
>>               ERROR Couldn't write to pipe: fd=6, len=4096, cmd="-close
>> /usr/local/ldm/agents/storeAndIngestFile.py
>> /data_store/polar/20260423/17/TICY70_KNES_231707_1130006.2026042317 TICX99"
>> 20260423T171759.293088Z pqact[3286699]
>>  palt.c:prodAction:1229              ERROR Couldn't process product:
>> feedtype=NOTHER, pattern="^(TICY70) (KNES) (..)(..)(..)", action=pipe,
>> args="-close /usr/local/ldm/agents/storeAndIngestFile.py
>> /data_store/polar/(\3:yyyy)(\3:mm)\3/\4/\1_\2_\3\4\5_(seq).%Y%m%d%H TICX99"
>> 20260423T171759.293385Z pqact[3286699]              filel.c:reap:3056
>>               WARN  Child 3295768 exited with status 1
>>
>> The pqact.conf entry is...
>> ANY<TAB>^(TICY70) (KNES) (..)(..)(..)
>> <TAB>PIPE<TAB>-close /usr/local/ldm/agents/storeAndIngestFile.py
>> /data_store/polar/(\3:yyyy)(\3:mm)\3/\4/\1_\2_\3\4\5_(seq).%Y%m%d%H TICX99
>>
>> I also ran the Python script from the command line, and it runs without
>> errors.
>>
>> I'm thinking a clue might be the presence of "-close" in the cmd entries
>> above, but I can't see anything wrong with the pqact.conf entry.
>>
>> Also, multiple products/patterns that use this PIPE action and script are
>> all failing with these errors.
>>
>> I appreciate any input!
>>
>> Matt
>>
>>
>> --
>> Matt Foster
>> Sr. Application Development Met.
>> NOAA Affiliate - KBR
>>
>>
>> _________________________________________________________
>> NOTE: All exchanges posted to NSF Unidata maintained email lists are
>> made publicly available through the web. Users who post to any of the
>> lists we maintain are reminded to remove any personal information that
>> they do not want to be made public.
>>
>> NSF Unidata ldm-users Mailing List
>> (ldm-users@xxxxxxxxxxxxxxxx)
>> For list information, to unsubscribe, or change your membership options,
>> visit: https://mailinglists.unidata.ucar.edu/listinfo/ldm-users/
>>
>

-- 
Matt Foster
Sr. Application Development Met.
NOAA Affiliate - KBR