Enhancement request - granules for USCODE & CFR

[RachitTechnology]

Can you please add support for sequential order for USCODE? Earlier versions for e.g. USCODE-2020-title2 used to return all nodes in sequential order. With 2021 , USCODE-2021-title2 returns them in non-sequential order
Edit : Same with CFR granules

[jonquandt]

Good morning -

Based on my check of the API, the order of the first 1000 granules listed for USCODE-2020-title2 and USCODE-2021-title2 appears to be identical.

I'm going to do a secondary check against the MODS metadata to verify the order.

[RachitTechnology]

Good morning @jonquandt . If we can get it in Ascending order of sequence number, that would be immensely helpful.

[RachitTechnology]

@jonquandt - Do you know when this will be available?

[RachitTechnology]

@jonquandt - Do you know if this will be implemented? It will be of great help

[jonquandt]

Thanks for following up on this. I am bumping this up in priority to see when we can make this available. In the meantime, you can find the sequence for each granule within the MODS files for a given CFR or USCODE package.

[RachitTechnology]

@jonquandt - Do you know if this will be implemented? It will be of great help

[jonquandt]

We're planning on taking another look at this in our next release, so likely to be out in mid-summer.

[RachitTechnology]

Thank you for the update

[RachitTechnology]

Using below python script currently, please check if this helps

import json
import csv
import re

def custom_sort_key(granule):
parts = re.split(r'[-]', granule['granuleId'])
numeric_parts = []

for part in parts:
    # Match chapters, sections, and any suffixes
    match = re.match(r'(title|chap|sec|part|subChapter|subtitle|subchap)(\d+)([a-zA-Z]*)', part)
    if match:
        prefix, number, suffix = match.groups()
        # Convert to int for sorting and keep track of the prefix and suffix
        numeric_parts.append((prefix, int(number), suffix))
    else:
        # Handle title or any other non-matching part as a string
        numeric_parts.append((part,))
return tuple(numeric_parts)

Load the JSON file

with open('granules.json', 'r', encoding='utf-8') as file:
data = json.load(file)

Delete granules where granuleClass is "FRONTMATTER" or "TOC"

data['granules'] = [granule for granule in data['granules'] if granule['granuleClass'] not in ["FRONTMATTER", "TOC"]]

Sort the remaining granules by granuleId using the custom sorting function

sorted_granules = sorted(data['granules'], key=custom_sort_key)

Update the data with the sorted granules

data['granules'] = sorted_granules

Save the sorted and filtered data back to a JSON file

with open('sorted_granules.json', 'w', encoding='utf-8') as file:
json.dump(data, file, indent=4)

print("Granules sorted by granuleId (after deleting FRONTMATTER and TOC) and saved as 'sorted_granules.json'.")

Convert sorted granules to CSV

csv_file_path = 'sorted_granules.csv'
with open(csv_file_path, 'w', newline='', encoding='utf-8') as csvfile: # Specify UTF-8 encoding here
fieldnames = ['granuleId', 'granuleLink', 'granuleClass', 'title']
writer = csv.DictWriter(csvfile, fieldnames=fieldnames)
writer.writeheader()

for granule in sorted_granules:
    writer.writerow({
        'granuleId': granule['granuleId'],
        'granuleLink': granule['granuleLink'],
        'granuleClass': granule['granuleClass'],
        'title': granule['title']
    })

print(f"Sorted granules (after deleting FRONTMATTER and TOC) have been saved as 'sorted_granules.csv'.")

[jonquandt]

We plan to have a fix deployed in our June release.

[RachitTechnology]

We plan to have a fix deployed in our June release.

Thank you so much!