Hello Tom,
Holy cow, we got 10% of our disk space back on that partition!
All right, I did just that. I wish the Canadian radars would somehow get booted
off of IDS|DDPLUS; this is a major pain the rear for us here.
In any case, I did this around 12:30Z, and later today or on Monday, I'll point
this back over to our server to see if it works.
Thank you for the help, I appreciate it, as always!
Gilbert Sebenste
Meteorology Support Analyst
College of DuPage
-----Original Message-----
From: Tom Yoksas <tyoksas@xxxxxxxxx>
Sent: Friday, April 3, 2026 1:11 AM
To: Sebenste, Gilbert <sebensteg@xxxxxxx>
Cc: Tom Yoksas <tyoksas@xxxxxxxxx>; mcidas-x@xxxxxxxxxxxxxxxx
Subject: 20260403: Re: [mcidas-x] 20260402: Re: [External] Re: Are tornado
watches and severe warnings plotting?
Hi Gilbert,
On 4/2/26 19:43, Sebenste, Gilbert wrote:
> That is so weird, because now that we are on new hardware, a new OS,
> we have the exact same issue: severe thunderstorm warnings and weather
> watches show up intermittently, if at all. I can't blame slow hardware now.
Actually, the problem is likely that the backing store files for textual
products for a day are exceeding the maximum size allowed for product storage
and product indexes into the file. See below for more details.
re:
> I am going to try replacing DDS with DDS|PPS. Do you think that will
> be acceptable to the XCD decoder?
This is not the problem, and, quite frankly, it will not work since the case
statement in the Bourne shell script 'xcd_run' does not handle this possibility:
xcd_run
...
case $1 in
DDS) exec ingetext.k DDS;;
IDS) exec ingetext.k DDS;;
PPS) exec ingetext.k DDS;;
DDPLUS) exec ingetext.k DDS;;
HRS) exec ingebin.k HRS;;
HDS) exec ingebin.k HRS;;
GRID) exec ingebin.k HRS;;
NCON) exec ingebin.k NCON;;
MONITOR)
# McIDAS environment in which to run STARTXCD # NB: Change POKEd value to 0
_IF_ you want XCD decoders to dump core files mcenv << EOF ucu.k POKE 142 1
exec startxcd.k EOF ;;
*) echo "xcd_run action $1 incorrectly specified, failing...";;
esac
What the likely cause of the problem is:
For several months, large binary products (like GRIB messages) have been
distributed in the IDS|DDPLUS feed, and these products are causing the backing
store files (*.XCD) to grow beyond their designed size limit (which is the size
of a 32-bit unsigned integer).
What you need to do is change your LDM pattern-action file to _not_ send those
large, binary products to the McIDAS-XCD textual ingester
'ingetext.k':
change:
IDS|DDPLUS .* PIPE
/path-to/xcd_run DDS
to:
IDS|DDPLUS ^([^LS]|S[^DR]|SD[^C]|SDC[^N]) PIPE
/path-to/xcd_run DDS
After making this change, you will need to stop your LDM, delete the overly
large *.XCD files and all pointer files for each day where the *.XCD are too
large, and then restart the LDM.
On Unidata systems running ADDE servers, the *.XCD files live
in:
/data/ldm/pub/decoded/mcidas
The size of the *.XCD files being kept there are currently:
/data/ldm/pub/decoded/mcidas: ls -alt *.XCD
-rw-rw-r-- 1 ldm ldm 307114080 Apr 3 05:58 DD260930.XCD
-rw-rw-r-- 1 ldm ldm 1304067600 Apr 2 23:59 DD260920.XCD
-rw-rw-r-- 1 ldm ldm 1307784000 Apr 1 23:59 DD260910.XCD
-rw-rw-r-- 1 ldm ldm 1295336640 Mar 31 23:59 DD260900.XCD
The index files for these files should live in the same directory, and will
have an .IDX suffix.
Since it is most likely that the *.XCD files on your system are all too large,
the simplest thing to do is simply delete all of the *.XCD and *.IDX files:
<in the directory that contain the *.XCD and *.IDX files on your machine(s)>
rm -f *.XCD *.IDX
NB: it is NOT sufficient to just delete the *.XCD files; the *.IDX files must
be deleted also!
It is only after all of these files have been deleted that you can safely
restart your LDM.
Please let me know if you would like a detailed explanation for the regular
expression I have included above, and if you like more information on the root
cause of this problem (which is not the NOAAPort ingester or LDM).
Cheers,
Tom
>> On Apr 2, 2026, at 6:32 PM, Tom Yoksas <tyoksas@xxxxxxxxx> wrote:
>>
>> Hi Gilbert,
>>
>>> On 4/2/26 15:56, Sebenste, Gilbert wrote:
>>> I was using ADDE.UCAR.EDU.
>>> I just switched to that, and I will see if that fixes it.
>>> On another note, I am using
>>> this in my pqact for McIDAS. Is this what you are using?
>>> IDS|DDPLUS .* PIPE
>>> /path-to/xcd_run DDS Is that what you are using?
>>
>> That is how I advised Unidata McIDAS-X users to setup McIDAS
>> processing in the LDM, and it is what Unidata's McIDAS/LDM instances are
>> setup.
>>
>> Cheers,
>>
>> Tom
>>
>>>>> On Apr 2, 2026, at 3:59 PM, Becky Schaffer <beckys@xxxxxxxxxxxxx> wrote:
>>>>
>>>>
>>>>
>>>> CAUTION: This email originated from outside of COD’s system. Do not click
>>>> links, open attachments, or respond with sensitive information unless you
>>>> recognize the sender and know the content is safe.
>>>>
>>>> Hi Gilbert,
>>>>
>>>> What server are you using for RTWXTEXT? I did a DATALOC ADD RTWXTEXT
>>>> ADDE.UNIDATA.UCAR.EDU and I'm seeing the following with WWDISP USA.
>>>>
>>>> Becky
>>>>
>>>> <b3dBYJmq5VlikmQz.png>
>>>>
>>>>
>>>>
>>>> On 4/2/2026 3:34 PM, Sebenste, Gilbert wrote:
>>>>> Hello everyone,
>>>>>
>>>>> I'm trying to figure out something. We make background overlays for our
>>>>> satellite imagery here, and severe convective warnings and weather
>>>>> watches are not plotting through McIDAS. Is anybody else having this
>>>>> issue?
>>>>>
>>>>> Gilbert Sebenste
>>>>> Meteorology Support Analyst
>>>>> College of DuPage
>>>>>
>>>>> _________________________________________________________
>>>>> NOTE: All exchanges posted to NSF Unidata maintained email lists
>>>>> are made publicly available through the web. Users who post to any
>>>>> of the lists we maintain are reminded to remove any personal
>>>>> information that they do not want to be made public.
>>>>>
>>>>> NSF Unidata mcidas-x Mailing List
>>>>> (mcidas-x@xxxxxxxxxxxxxxxx)
>>>>> For list information, to unsubscribe, or change your membership
>>>>> options,
>>>>> visit:https://nam02.safelinks.protection.outlook.com/?url=https%3A
>>>>> %2F%2Furldefense.com%2Fv3%2F__https%3A%2F%2Fmailinglists.unidata.u
>>>>> car.edu%2F&data=05%7C02%7Csebensteg%40cod.edu%7C750448e43d464d0c5f
>>>>> 1308de9147d648%7Cbe87d92eecd84586b47ca50466d04f4d%7C0%7C0%7C639107
>>>>> 934910038741%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiO
>>>>> iIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C
>>>>> 0%7C%7C%7C&sdata=wbMdRemVt6oX5XtRFexhJNT31ry7P6B0PeIjS%2FGA8wc%3D&
>>>>> reserved=0 listinfo/mcidas-x/__;!!Mak6IKo!J0BZwB-
>>>>> bsUOWnc2I3lV7H9laD_61untihiOud9llaeDZXAdE55IoZrLGNvttJMJ7dIfhusg5H
>>>>> tXhxxtIOFIr1w$
>>>>
>>> _________________________________________________________
>>> NOTE: All exchanges posted to NSF Unidata maintained email lists are
>>> made publicly available through the web. Users who post to any of
>>> the lists we maintain are reminded to remove any personal
>>> information that they do not want to be made public.
>>> NSF Unidata mcidas-x Mailing List
>>> (mcidas-x@xxxxxxxxxxxxxxxx)
>>> For list information, to unsubscribe, or change your membership
>>> options,
>>> visit:
>>> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fma
>>> ilinglists.unidata.ucar.edu%2Flistinfo%2Fmcidas-x%2F&data=05%7C02%7C
>>> sebensteg%40cod.edu%7C750448e43d464d0c5f1308de9147d648%7Cbe87d92eecd
>>> 84586b47ca50466d04f4d%7C0%7C0%7C639107934910057233%7CUnknown%7CTWFpb
>>> GZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsI
>>> kFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=RUuuucfMZ4nD6yL4L
>>> Y9K6yhJnw%2FojJcu3E1pCstsppY%3D&reserved=0
>>
>> --
>> +----------------------------------------------------------------------+
>> * Tom Yoksas +
>> * 230 Nightshade Dr. +
>> * Boulder, CO 80302 +
>> * 303.258.0906 +
>> +----------------------------------------------------------------------+
>>
>> _________________________________________________________
>> NOTE: All exchanges posted to NSF Unidata maintained email lists are
>> made publicly available through the web. Users who post to any of the
>> lists we maintain are reminded to remove any personal information
>> that they do not want to be made public.
>>
>> NSF Unidata mcidas-x Mailing List
>> (mcidas-x@xxxxxxxxxxxxxxxx)
>> For list information, to unsubscribe, or change your membership
>> options,
>> visit:
>> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmai
>> linglists.unidata.ucar.edu%2Flistinfo%2Fmcidas-x%2F&data=05%7C02%7Cse
>> bensteg%40cod.edu%7C750448e43d464d0c5f1308de9147d648%7Cbe87d92eecd845
>> 86b47ca50466d04f4d%7C0%7C0%7C639107934910068205%7CUnknown%7CTWFpbGZsb
>> 3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIj
>> oiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=sPgP1r5jAw8uI3SYmDD2IfE
>> %2F86krSVCOEdZK1uoNJhw%3D&reserved=0
--
+----------------------------------------------------------------------+
* Tom Yoksas +
* 230 Nightshade Dr. +
* Boulder, CO 80302 +
* 303.258.0906 +
+----------------------------------------------------------------------+