I found the following solution:
#show figure.caption: it => {
align(box(align(it, left)), center)
}
This sets the alignment of the caption to left-bound inside the box but then centers the box in relation to the figure. If anybody knows of a better solution, please feel free to comment.