Plugin Value upload gets stuck
I am currently developing a plugin where I need information for every element in our data (~ 7500). As Piotr suggested, I am uploading the data as key-value pairs for the plugin. (element id as key and a json string (< 300 kB) as value)
On the local docker image, everything (including the value upload) works fine without any errors.
However, now I want to publish the plugin on the public server (https://air.elixir-luxembourg.org/) and the upload gets stuck between 5 - 10% every time without any errors (at different percentages so there shouldn't be any problems with the data itself.
Here is the simple python script ('paths' is an N * [key, value] array)
url = "https://air.elixir-luxembourg.org/minerva/api/"
data = {'login' : '*',
'password':'*'}
response = requests.post(url = url + "doLogin", data=data)
if not response:
print("Error")
sys.exit()
token = json.loads(response.text)["token"]
cookie = {"MINERVA_AUTH_TOKEN" : token}
for i in range(0,len(paths)):
printProgressBar(i, len(paths) - 1, prefix = 'Progress:', suffix = 'Complete', length = 50)
if len(paths[i]) >= 2:
key = paths[i][0]
data = {'value' : paths[i][1] }
setkey_response = requests.post(url = url + "plugins/" + pluginhash + "/data/global/" + key, data=data, cookies = cookie)
if setkey_response:
success_elementsizes.append(sys.getsizeof(paths[i][1]))
countsuccess += 1