Why are the performance improvements so modest? #6

Open
opened 2026-09-16 19:50:42 +00:00 by urusan · 0 comments
Owner

When I ran a training that only changed around 7% of the modules in sd-scripts, it only saved around 30% of the time. It also had a weird halting and restarting pattern during the early part of the run. This suggests there MIGHT be a performance issue and maybe if we can fix this we can get much faster training.

That said, it may not be possible, especially if the modules omitted were relatively small or if there's a lot of other stuff going on.

When I ran a training that only changed around 7% of the modules in sd-scripts, it only saved around 30% of the time. It also had a weird halting and restarting pattern during the early part of the run. This suggests there MIGHT be a performance issue and maybe if we can fix this we can get much faster training. That said, it may not be possible, especially if the modules omitted were relatively small or if there's a lot of other stuff going on.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
urusan/lora-RnD#6
No description provided.