Cannot create new asset with image from Google Drive/Dropbox

When I try to create a new asset via the Content Management API, it creates it with the image if I use an image from a website, but it does not process the image if I use a link from Google Drive or Dropbox, or from a random image on Google images.
Here is an example curl request with an image link from Google images:

curl --include \
     --request PUT \
     --header 'Authorization: Bearer <TOKEN>' \
     --header 'Content-Type: application/' \
     --data-binary '{
       "fields": {
         "title": {
           "en-US": "Test"
         "file": {
           "en-US": {
             "contentType": "image/png",
             "fileName": "test",
             "upload": ""
     }' \

It creates the asset, but does not upload the image, and the Media type will be markup instead of image. The same happens if I try this with a shared image from Drive or Dropbox.