Skip to content
This repository was archived by the owner on Dec 6, 2024. It is now read-only.
This repository was archived by the owner on Dec 6, 2024. It is now read-only.

Event streaming fail for thousands of records #8

@ahmadRagheb

Description

@ahmadRagheb

how to reproduce :
1- data import data with 5000 or more recorded
2- the system will fail to send it all

my error log

frappe.event_streaming.doctype.event_producer.event_producer.pull_from_node
Error
Traceback (most recent call last):
File "/home/frappe/frappe-bench/apps/frappe/frappe/utils/background_jobs.py", line 104, in execute_job
method(**kwargs)
File "/home/frappe/frappe-bench/apps/frappe/frappe/event_streaming/doctype/event_producer/event_producer.py", line 209, in pull_from_node
updates = get_updates(producer_site, last_update, doctypes)
File "/home/frappe/frappe-bench/apps/frappe/frappe/event_streaming/doctype/event_producer/event_producer.py", line 368, in get_updates
'last_update': last_update
File "/home/frappe/frappe-bench/apps/frappe/frappe/frappeclient.py", line 308, in post_request
res = self.post_process(res)
File "/home/frappe/frappe-bench/apps/frappe/frappe/frappeclient.py", line 321, in post_process
rjson = response.json()
File "/home/frappe/frappe-bench/env/lib/python3.6/site-packages/requests/models.py", line 900, in json
return complexjson.loads(self.text, **kwargs)
File "/usr/lib/python3.6/json/init.py", line 354, in loads
return _default_decoder.decode(s)
File "/usr/lib/python3.6/json/decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/lib/python3.6/json/decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions