Developers Lack Understanding of Data Transfer Costs in GPU Computing

Programmers underestimate PCIe and memory bandwidth costs for moving data between CPU and GPU, leading to poor algorithm designs that don't account for transfer overhead, particularly for smaller workloads.

Sources

• What problems fit to GPU? — GPU programming
• What Every Developer Should Know About GPU Computing (2023)

Collection History