Show HN: Multi-region Vertex AI inference router with Cloud Run (opens in new tab)

(medium.com)

1 pointsbernieongewe2mo ago2 comments

2 comments

OP here. Seems there are a number of folks struggling with this. Happy to answer questions about the networking setup.

Why not use the global vertex ai endpoints instead of region balancing?

1. This is Google's own recommendation, despite the latency concerns

2. Some models are only available in the global region.

Where/why are folks struggling with this?

j / k navigate · click thread line to collapse

OP here. Seems there are a number of folks struggling with this. Happy to answer questions about the networking setup.

Why not use the global vertex ai endpoints instead of region balancing?

1. This is Google's own recommendation, despite the latency concerns

2. Some models are only available in the global region.

Where/why are folks struggling with this?

j / k navigate · click thread line to collapse