undefined | Better HN

0 pointsenigmo3mo ago0 comments

having a local simulator (DynamoDB, Spanner, others) helps me a lot for offline/local development and CI. when a vendor doesn't off this I have often end up mocking it out (one way or another) and have to wait for integration or e2e tests for feedback that could have been pushed further to the left.

in many CI environments unit tests don't have network access, it's not purely a price consideration.

(not a turbopuffer customer but I have been looking at it)

0 comments

benesch3mo ago

> in many CI environments unit tests don't have network access, it's not purely a price consideration.

I've never seen a hard block on network access (how do you install packages/pull images?) but I am sympathetic to wanting to enforce that unit tests run quickly by minimizing/eliminating RTT to networked services.

We've considered the possibility of a local simulator before. Let me know if it winds up being a blocker for your use case.

lambda3mo ago

> how do you install packages/pull images

You pre-build the images with packages installed beforehand, then use those image offline.

benesch3mo ago

My point is it's enough of a hassle to set up that I've yet to see that level of restriction in practice (across hundreds of CI systems).

dzbarsky3mo ago

Look into Bazel, a very standard build system used at many large tech companies. It splits fetches from build/test actions and allows blocking network for build/test actions with a single CLI flag. No hassle at all.

The fact that you haven't come across this kind of setup suggests that your hundreds of CI systems are not representative of the industry as a whole.

1 more reply

enigmoOP3mo ago

you pull packages from a trusted package repository, not from the internet. this is not rare in my experience (financial services, security) and will become increasingly common due to software supply chain issues.

j / k navigate · click thread line to collapse

0 comments

benesch3mo ago

> in many CI environments unit tests don't have network access, it's not purely a price consideration.

We've considered the possibility of a local simulator before. Let me know if it winds up being a blocker for your use case.

lambda3mo ago

> how do you install packages/pull images

You pre-build the images with packages installed beforehand, then use those image offline.

benesch3mo ago

My point is it's enough of a hassle to set up that I've yet to see that level of restriction in practice (across hundreds of CI systems).

dzbarsky3mo ago

The fact that you haven't come across this kind of setup suggests that your hundreds of CI systems are not representative of the industry as a whole.

1 more reply

enigmoOP3mo ago

j / k navigate · click thread line to collapse