Can't import a complex WDL workflow - it keeps timing out

Hi Dockstore team,

I’m trying to import a more complext workflow and I keep hitting this error:

[HTTP 504] OK: 504 Gateway Time-out

504 Gateway Time-out

The worklow is this one: warp/verification/test-wdls/TestIlluminaGenotypingArray.wdl at develop · broadinstitute/warp · GitHub

Hi,

Can you elaborate on what you were doing when you saw this error? And where you see it? The warp workflows are registered via a .dockstore.yml and should automatically get updated. But I see from our logs that perhaps you tried to “manually register” the workflow as well?

I do see several read errors for TestIlluminaGenotypringArray.wdl in our logs, but they seem legit, e.g., IOException on readFileFromRepo /verification/test-wdls/TestIlluminaGenotypingArray.wdl from repository broadinstitute/warp:SS2-terra-memory-increase, https://api.github.com/repos/broadinstitute/warp/contents//verification/test-wdls?ref=SS2-terra-memory-increase, but that file doesn’t exist on the branch, so it seems correct.

A little more detail would help narrow down where to look.

Thanks,

Charles

Hi, thanks for the reply. Yes, I was manually importing the workflow. This particular workflow is not on our .yml file. We were trying to test out how it would run in Terra. This workflow belongs to a group to test workflows. If it works in Terra, then we would bring all of them into Dockstore using the .yml file. But right now, I just want to register this one workflow. It looks like the workflow registered, but it tells me to refresh to see workflow versions. Every time I refresh, it hits the error. I’ll attach a few screenshots.


Hello! A possible solution would be to add the test workflow to your .dockstore.yml on the develop branch (or whatever branch/tag you prefer), then push, which should cause it to be registered with a single version that corresponds to that branch/tag. That’ll use our newer registration path, which better handles the large number of branches/tags in the warp repo.

Would that work for you?

Steve