enhancement to parse_html

[haihongren]

enhancement

• added parse_html_attributes function to allow html element attribute to be parsed and included in the value, for example: class of the element

Use case
Google cloud service status web site uses class to show the status of the service.
https://status.cloud.google.com/

Working Example: GCP status

integrations:
  - name: nri-flex
    config:
      name: gcpStatus
      apis:
        - name: gcpStatus
          event_type: gcpStatus
          url: https://status.cloud.google.com/
          parse_html: true
          parse_html_attributes: 
            class: .*
          
          remove_keys: 
            - class
            - style
            - index
          
          value_mapper:
            Americas  regions:
                - (__cell;$)=>N/A
                - (.*__available;.*)=>Normal
                - (.*__information;.*)=>Info         
                - (.*__warning;.*)=>Warning
            Asia Pacific  regions:
                - (__cell;$)=>N/A
                - (.*__available;.*)=>Normal
                - (.*__information;.*)=>Info
                - (.*__warning;.*)=>Warning                                 
            Europe  regions:
                - (__cell;$)=>N/A
                - (.*__available;.*)=>Normal
                - (.*__information;.*)=>Info    
                - (.*__warning;.*)=>Warning                              
            Global:
                - (__cell;$)=>N/A
                - (.*__available;.*)=>Normal   
                - (.*__information;.*)=>Info    
                - (.*__warning;.*)=>Warning                                                                           
            Multi regions:
                - (__cell;$)=>N/A
                - (.*__available;.*)=>Normal 
                - (.*__information;.*)=>Info  
                - (.*__warning;.*)=>Warning                                 
            Products: 
                - (.*;)(.*)=>$2                                                            

[rogercoll]

Hi @haihongren ,

Could you add some end-to-end tests in https://github.com/newrelic/nri-flex/tree/master/test/testbed that cover this use case?
In addition, could you sign the commits?

Thanks for the contribution!

[haihongren]

@rogercoll thanks for the comments.
I have added e2e test for parse_html_attributes and also signed the commit.
The added e2e test passed.

    --- PASS: TestUrlAPI/html_parse_attributes_parse_html_attributes (0.03s)

The two failed e2e tests are not from my changes. Thanks!

    --- FAIL: TestCommandAPI/Linux_file_list_of_the_/etc/apt_directory_removing_header (0.03s)
    --- FAIL: TestCommandAPI/Linux_file_list_of_the_/etc/apt_directory_filtering_lines (0.03s)

[Kav91]

LGTM nice 👍🏾