Cannot create new asset with image from Google Drive/Dropbox

When I try to create a new asset via the Content Management API, it creates it with the image if I use an image from a website, but it does not process the image if I use a link from Google Drive or Dropbox, or from a random image on Google images.
Here is an example curl request with an image link from Google images:

curl --include \
     --request PUT \
     --header 'Authorization: Bearer <TOKEN>' \
     --header 'Content-Type: application/vnd.contentful.management.v1+json' \
     --data-binary '{
       "fields": {
         "title": {
           "en-US": "Test"
         },
         "file": {
           "en-US": {
             "contentType": "image/png",
             "fileName": "test",
             "upload": "https://images.app.goo.gl/YDCPYbdEFAVNDokv5"
           }
         }
       }
     }' \
     https://api.contentful.com/spaces/dtigw1ldgyh9/environments/master/assets/testImage

It creates the asset, but does not upload the image, and the Media type will be markup instead of image. The same happens if I try this with a shared image from Drive or Dropbox.