Issue 2551144: Use subtransactions for error handling during roundup import??

classification

Title:	Use subtransactions for error handling during roundup import??
Type:	resource usage	Severity:	normal
Components:		Versions:

process

Status:	new	Resolution:
Dependencies:		Superseder:
Assigned To:		Nosy List:	rouilj
Priority:		Keywords:

Created on 2021-06-13 19:42 by rouilj, last changed 2021-06-13 19:42 by rouilj.

Messages
msg7282	Author: [hidden] (rouilj)	Date: 2021-06-13 19:42
in issue2551142, I "fixed" the problem by committing after every row in the csv import was created. This has performance implications. Implementing this using subtransactions in posgresql: https://postgres- py.readthedocs.io/en/latest/#postgres.Postgres.get_cursor may allow us to solve the initial issue without having to perform a per-row commit. I am not sure how this interacts with the python DBI standard and how roundup interacts with the database, but it is worth a look.

msg7282

Author: [hidden] (rouilj)

Date: 2021-06-13 19:42

in issue2551142, I "fixed" the problem by committing after every row in 
the csv import was created. This has performance implications.

Implementing this using subtransactions in posgresql:

  https://postgres-
py.readthedocs.io/en/latest/#postgres.Postgres.get_cursor

may allow us to solve the initial issue without having to
perform a per-row commit.

I am not sure how this interacts with the python DBI standard and how 
roundup interacts with the database, but it is worth a look.

History
Date	User	Action	Args
2021-06-13 19:42:33	rouilj	create

Roundup Tracker - Issues

Issue 2551144