Forum Settings
Forums
New
Mar 9, 2022 9:15 PM
#1
Offline
Feb 2022
3
Hi! Is there a way to make a search with the API in a way i can get a list with all the animes/users?

I've already managed to get the data from the API, but not in the way i wanted, don't know if i'm missing something here.

Thanks in advance!
Reply Disabled for Non-Club Members
Mar 10, 2022 5:34 AM
#2
四十二

Offline
Mar 2016
479
ricardomarra said:
Hi! Is there a way to make a search with the API in a way i can get a list with all the animes/users?

I've already managed to get the data from the API, but not in the way i wanted, don't know if i'm missing something here.

Hi! I'm not sure I've understood what you wish to accomplish. Do you want to retrieve a full list of all anime series added to the database? Or do you want to search an entry given part of its name?
HTCPCP/1.0  ★ MetaMAL  ★ Picture credits: Kieed & 1041uuu
Mar 10, 2022 5:47 AM
#3
Offline
Feb 2022
3
Hey, thanks for the reply!

Sorry if i didn't give a proper explanation.

Yeah, i'm trying to retrieve a full list of all anime series in the database. This and/or a list of all users with their scores for each watched series too. Just to make a dataset so i can do some analysis and mess around with a recommendation system.
Mar 10, 2022 7:12 AM
#4
四十二

Offline
Mar 2016
479
ricardomarra said:
Yeah, i'm trying to retrieve a full list of all anime series in the database. This and/or a list of all users with their scores for each watched series too. Just to make a dataset so i can do some analysis and mess around with a recommendation system.

Well, there's no way to retrieve the entire database with a single command. The easiest alternative is probably to query all anime by ID one by one, starting from 1 to around 52000.

Make sure to insert a short delay (~500-1,000 ms) before each API call to avoid sending too many requests in a short time. Also, if possible, try to recycle the same HTTP connection rather than creating a new one for each request.

The entire process should take several hours, so test it beforehand with a smaller set of IDs. Also, keep in mind that removed and non-existing entries will return a 404 status code.

The same process cannot be applied to users' anime lists as they're not indexed by ID. There's no easy way to retrieve a full list of all users registered to MAL (and you probably shouldn't try to build it using other methods).
HTCPCP/1.0  ★ MetaMAL  ★ Picture credits: Kieed & 1041uuu
Mar 10, 2022 4:19 PM
#5
Offline
Feb 2022
3
Yeah, as i thought retrieving all the users isn't gonna be possible haahha.

Thanks for the time and clarification!
Jun 1, 2022 8:22 PM
#6
Offline
Jun 2022
1
So there is a way to retrieve other users' info? Like what they have already watched, reviews they gave, and other stuff?
Jun 2, 2022 9:42 AM
#7
四十二

Offline
Mar 2016
479
artsjk7 said:
So there is a way to retrieve other users' info? Like what they have already watched, reviews they gave, and other stuff?

You cannot retrieve the reviews of a user, but you can use the Get user anime list and Get my user information endpoints to obtain some of the info you need.
HTCPCP/1.0  ★ MetaMAL  ★ Picture credits: Kieed & 1041uuu
Reply Disabled for Non-Club Members

More topics from this board

» [discontinued] I made a webapp to compare plan-to-watch lists

daux - Apr 16, 2022

33 by daux »»
Oct 2, 4:17 PM

» Requesting additional authorizations

SomeNewGuy - Aug 18

1 by ZeroCrystal »»
Aug 22, 8:31 AM

» Scraping from HTML suggested rate

Davenzo - Jan 8, 2023

4 by 7k72 »»
Jun 23, 6:35 AM

» Accessing Many Users' List

loukylor - Jun 11

0 by loukylor »»
Jun 11, 3:07 PM

» Caching strategy to avoid making additional API calls

Jakuten - Jun 3

4 by Jakuten »»
Jun 8, 11:30 AM
It’s time to ditch the text file.
Keep track of your anime easily by creating your own list.
Sign Up Login