Re: [ldm-users] Fwd: (#YWY-5617231) Re: Recovery Assistance (NOAAPort NWSTG Data - DSI 6431_03)

Greetings fellow LDMers,

Since Daryl brought this up:

They are built from the following pqact entry

IDS|DDPLUS      ^([^S]|S[^D]|SD[^C]|SDC[^N])
        FILE    -close  .../%Y%m%d%H.txt

So there's nastiness to keep Canadian RADAR data out of those files, le
sigh.

I know this has been going on for a while now, but I'll ask anyways...  Can
RADAR data be moved to another feedtype? Like say, NEXRAD3?

I can already hear Stonie say this is blasphemy for Unidata to assert some
decision making like this, and while I would normally agree I think this is
an obvious case of course correction instead of decision making, nor a
slippery slope.  I just don't see how radar data fits in either IDS or
DDPLUS, and Daryl brings up a clear case of how this is at least
inconvenient to work around, maybe even disruptive to those who are not
aware of the situation.

Just my two cents, thanks for listening.

Best,
-Mike

On Fri, Jan 9, 2026 at 8:56 AM Herzmann, Daryl E [AGRON] <
akrherz@xxxxxxxxxxx> wrote:

> Greetings,
>
> Perhaps these bulk UTC daily files will provide you with what you need.
>
> https://mesonet-longterm.agron.iastate.edu/archive/raw/noaaport/2025/
>
> They are built from the following pqact entry
>
> IDS|DDPLUS      ^([^S]|S[^D]|SD[^C]|SDC[^N])
>         FILE    -close  .../%Y%m%d%H.txt
>
> So there's nastiness to keep Canadian RADAR data out of those files, le
> sigh.
>
> daryl
>
> ________________________________________
> From: ldm-users <ldm-users-bounces@xxxxxxxxxxxxxxxx> on behalf of Shane
> Taitt - NOAA Federal <shane.taitt@xxxxxxxx>
> Sent: Friday, January 9, 2026 7:37 AM
> To: ldm-users@xxxxxxxxxxxxxxxx
> Cc: Margaret Curtis - NOAA Federal; _NCEP NCO IDP Dataflow; _NCO HPC
> Dataflow; Jesse Marks - NOAA Affiliate; Holly Uhlenhake - NOAA Federal
> Subject: [ldm-users] Fwd: (#YWY-5617231) Re: Recovery Assistance (NOAAPort
> NWSTG Data - DSI 6431_03)
>
> Hello,
>
> Please see below.  Does anybody in the community have this NOAAPort NWSTG
> data covering the period from 08/23-08/30?  We typically get this data in,
> via LDM, with IDS|DDPLUS but missed this data due to a long-term system
> outage.
>
>
>
>
>
>
>
> Have a great weekend!
>
> Shane
>
> ---------- Forwarded message ---------
> From: NSF Unidata Local Data Manager (LDM) <support-ldm@xxxxxxxxxxxxxxxx
> <mailto:support-ldm@xxxxxxxxxxxxxxxx>>
> Date: Mon, Dec 22, 2025 at 12:16 PM
> Subject: (#YWY-5617231) Re: Recovery Assistance (NOAAPort NWSTG Data - DSI
> 6431_03)
> To: <shane.taitt@xxxxxxxx<mailto:shane.taitt@xxxxxxxx>>
>
>
> -#-#- Please reply above this line -#-#-
>
> Dear Shane Taitt - NOAA Federal,
>
> We have received your request and someone will be looking at it shortly .
> We are committed to resolving every ticket as promptly as possible, and we
> encourage you to let us know if you have any additional concerns or
> questions by replying to this email.
> ________________________________
> Ticket Details
> Ticket #: YWY-5617231
> Subject: Re: Recovery Assistance (NOAAPort NWSTG Data - DSI 6431_03)
> Department: Local Data Manager (LDM)
> Status: Open
> ________________________________
> [X]
> Shane Taitt - NOAA Federal
> User - Monday 22nd December 2025 5:15 AM
>
> NCO Dataflow,
>
> After discovering this data's not provided by you guys, please disregard.
> Sorry.
>
> Unidata Support, can you please assist with this data recovery?
>
>
>
>
>
>
>
>
>
> Shane
>
> On Fri, Nov 21, 2025 at 2:45 PM Shane Taitt - NOAA Federal <
> shane.taitt@xxxxxxxx<mailto:shane.taitt@xxxxxxxx>> wrote:
> Margaret,
>
> This data's different and thanks for looking!
>
> On Fri, Nov 21, 2025 at 12:34 PM Margaret Curtis - NOAA Federal <
> margaret.curtis@xxxxxxxx<mailto:margaret.curtis@xxxxxxxx>> wrote:
> Is this the same or different than the request to recover " TAC/GTS data
> from 08/26 - 08/29. We ingest the TAC/GTS from
> ftpprd.ncep.noaa.gov/pub/data2/NCDC/rawobs<
> http://ftpprd.ncep.noaa.gov/pub/data2/NCDC/rawobs> and files should look
> like 20250822.sonde."   from  Pichai Polprasert ?   @Jesse Marks -
> DF<mailto:jesse.marks@xxxxxxxx>  has staged a bunch of data for them, we
> can look for this one too.
>
> Margaret
>
> On Fri, Nov 21, 2025 at 7:05 AM Holly Uhlenhake - NOAA Federal <
> holly.uhlenhake@xxxxxxxx<mailto:holly.uhlenhake@xxxxxxxx>> wrote:
> Morning Shane,
>
> It's not always easy to know what datasets we need to keep, but we do have
> some data for you.  Dates I see on the supercomputer are from August 25th
> to Sept 8th. Hopefully that gets most of what you need.  I'll talk to both
> teams about how we normally get this data back to you.
>
> Thanks,
> Holly
>
> On Thu, Nov 20, 2025 at 10:50 PM Carissa Klemmer - NOAA Federal <
> carissa.l.klemmer@xxxxxxxx<mailto:carissa.l.klemmer@xxxxxxxx>> wrote:
> Casting a wider net to have the teams assist with this.
>
> IDP, HPC, can you together figure out what needs to be done to help get
> the data back.
>
> Carissa Klemmer
> NCEP Central Operations
> IDSB Branch Chief
> 301-683-3835
>
>
> On Wed, Nov 19, 2025 at 9:59 AM Shane Taitt - NOAA Federal <
> shane.taitt@xxxxxxxx<mailto:shane.taitt@xxxxxxxx>> wrote:
> Good morning ma'ams!
>
> Now that we've gotten NCEI's Common Ingest system stable and are able to
> invest more time in data recovery, I was wondering if it'd be possible to
> provide us with Subject data from 08/23-08/30.  I know this is a few months
> back but we're severely undermanned and have been spending the last three
> months trying to restore not only Common Ingest but other data stewardship
> systems and haven't had the time or resources to routinely monitor and
> steward data like we normally would.
>
>
>
>
>
> Have a great day!
>
> Shane
>
> --
> Shane Taitt
> Data Scientist
> NOAA's National Centers for Environmental Information (NCEI)
> Data Stewardship Division | Data Operations Branch
> shane.taitt@xxxxxxxx<mailto:shane.taitt@xxxxxxxx>
> (828) 271-4335
> ________________________________
> You can review the ticket by going to:
>
> https://support.unidata.ucar.edu/tickets/view/YWY-5617231?token=7d40368731bb459ecf90e914b9a956feef602191
>
> Kind Regards,
> NSF Unidata
> _________________________________________________________
> NOTE: All exchanges posted to NSF Unidata maintained email lists are
> made publicly available through the web. Users who post to any of the
> lists we maintain are reminded to remove any personal information that
> they do not want to be made public.
>
> NSF Unidata ldm-users Mailing List
> (ldm-users@xxxxxxxxxxxxxxxx)
> For list information, to unsubscribe, or change your membership options,
> visit: https://mailinglists.unidata.ucar.edu/listinfo/ldm-users/
>