feat: add "web-scraping-linkedin-jobs-using-puppeteer" blog post #28
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
aleix10kst
reviewed
Oct 13, 2023
blog/ca/3_web-scraping-de-feines-a-linkedIn-utilitzant-puppeteer-i-rxjs.mdx
Outdated
Show resolved
Hide resolved
| ]; | ||
| ``` | ||
|
|
||
| To iterate through the `searchParamsList` array, we essentially need to convert it from an Array to an Observable using the `fromArray` operator. Subsequently, we will use the `concatMap` operator to sequentially process each searchText and locationText pair. The power of RxJS here is that, in the case where we may want to switch from sequential to parallel processing, we just need to change the `concatMap` for a `mergeMap`. In this case, it is not recommended because we will exceed LinkedIn's rate limits, but it's something to consider in other scenarios. |
blog/ca/3_web-scraping-de-feines-a-linkedIn-utilitzant-puppeteer-i-rxjs.mdx
Outdated
Show resolved
Hide resolved
|
|
||
| ### RxJS | ||
|
|
||
| [RxJS](https://rxjs.dev/) és una biblioteca per a la programació reactiva en JavaScript. Proporciona un conjunt d'eines i abstraccions per treballar amb fluxos de dades asincrònics. Utilitzarem RxJS en aquest exemple perquè ofereix els avantatges següents: |
There was a problem hiding this comment.
"asincrònics" or "asíncrons"?
There was a problem hiding this comment.
😆 ChatGPT 4 fent de les seves.... sona molt millor asíncron si. Asincrònic sembla també vàlid, però no l'havia sentit mai
|
|
||
| ``` | ||
|
|
||
| El codi proporcionat extreu efectivament tota la informació de treball disponible de la pàgina. Encara que el codi és molt estètic, aconsegueix la feina, que és típic per a codi de "scraping" web. |
There was a problem hiding this comment.
"Encara que el codi és molt estètic", what do you mean by that?
There was a problem hiding this comment.
Hauria de ser "Encara que el codi NO és molt estètic" (falta el NO) tot hi que estaria be reformular una mica la frase
blog/ca/3_web-scraping-de-feines-a-linkedIn-utilitzant-puppeteer-i-rxjs.mdx
Outdated
Show resolved
Hide resolved
blog/ca/3_web-scraping-de-feines-a-linkedIn-utilitzant-puppeteer-i-rxjs.mdx
Outdated
Show resolved
Hide resolved
blog/ca/3_web-scraping-de-feines-a-linkedIn-utilitzant-puppeteer-i-rxjs.mdx
Outdated
Show resolved
Hide resolved
blog/ca/3_web-scraping-de-feines-a-linkedIn-utilitzant-puppeteer-i-rxjs.mdx
Outdated
Show resolved
Hide resolved
blog/ca/3_web-scraping-de-feines-a-linkedIn-utilitzant-puppeteer-i-rxjs.mdx
Outdated
Show resolved
Hide resolved
llorenspujol
force-pushed
the
blog/web-scraping-linkedin-jobs-using-puppeteer-and-rxjs
branch
from
0ceba97 to
fd914bb
Compare
llorenspujol
force-pushed
the
blog/web-scraping-linkedin-jobs-using-puppeteer-and-rxjs
branch
from
fd914bb to
cca6b0a
Compare
aleix10kst
reviewed
Oct 16, 2023
| /assets/blog/web-scraping-de-feines-a-linkedin-utilitzant-puppeteer-i-rxjs/cover-image.png | ||
| --- | ||
|
|
||
| El web scraping pot semblar una tasca senzilla, però hi ha molts reptes a superar. En aquest blog, ens endinsarem en com fer "scraping" a LinkedIn per extreure ofertes de feina. Per fer això, utilitzarem [Puppeteer](https://pptr.dev/) i [RxJS](https://rxjs.dev/). L'objectiu és assolir web scraping d'una manera declarativa, modular i escalable. |
There was a problem hiding this comment.
Més que endinsarem, diria aprendrem.
|
|
||
| > Alguns dels fragments en aquest blog poden ometre parts per claredat. Podeu trobar el codi complet en aquest [repositori](https://github.com/llorenspujol/linkedin-jobs-scraper). | ||
|
|
||
| This translation maintains the meaning of the original English text in Catalan. |
There was a problem hiding this comment.
Això s'hauria de treure no?
|
|
||
| ## Anar a la llista de llocs de treball de LinkedIn i extreure les dades | ||
|
|
||
| Aquesta és la part central d'aquest bloc, on ens submergim en el procés d'accés a les ofertes de feina de LinkedIn, analitzant el contingut HTML i recuperant les dades d'ofertes de feina en format JSON. |
aleix10kst
approved these changes
Oct 17, 2023
aleix10kst
previously approved these changes
Oct 17, 2023
llorenspujol
force-pushed
the
blog/web-scraping-linkedin-jobs-using-puppeteer-and-rxjs
branch
from
5348dee to
91afc88
Compare
aleix10kst
approved these changes
Oct 17, 2023
llorenspujol
deleted the
blog/web-scraping-linkedin-jobs-using-puppeteer-and-rxjs
branch
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Draft previ a afegir el blog de com fer "scraping " a linkedin. Em falten algunes millores en el blog, i espero trobar també una millor foto de portada