{ "cells": [ { "cell_type": "code", "execution_count": 87, "id": "176d8979-d200-4428-8786-f005a717ed7e", "metadata": {}, "outputs": [], "source": [ "# SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.\n", "# SPDX-License-Identifier: Apache-2.0." ] }, { "cell_type": "markdown", "id": "b8526874-c854-4693-8428-b013544267d4", "metadata": {}, "source": [ "# Example of a simple retrieval pipeline using Nemotron ColEmbed VL 4B/8B v2 and Vidore V3" ] }, { "cell_type": "markdown", "id": "b5c00356-4f86-4718-8110-fd1583d43b81", "metadata": {}, "source": [ "This notebook demonstrates a simple indexing and search pipeline of [nvidia/nemotron-colembed-vl-4b-v2](https://huggingface.co/nvidia/nemotron-colembed-vl-4b-v2) / [nvidia/nemotron-colembed-vl-8b-v2](https://huggingface.co/nvidia/nemotron-colembed-vl-8b-v2) late-interaction embedding model using a dataset from the [Vidore V3 benchmark](https://huggingface.co/blog/QuentinJG/introducing-vidore-v3). \n", "Check more information about Nemotron ColEmbed v2 models in this [blog post](https://huggingface.co/blog/nvidia/nemotron-colembed-v2)." ] }, { "cell_type": "markdown", "id": "e4eed691", "metadata": {}, "source": [ "### Setup\n", "We have tested this notebook with A100 80G GPU card. We recommend a GPU with Ampere or later micro-architecture (requirement for using FlashAttention 2), with at least 24 GB memory. \n", "\n", "**Install and import dependencies.**" ] }, { "cell_type": "code", "execution_count": null, "id": "5bf781e8", "metadata": {}, "outputs": [], "source": [ "!pip install qwen_vl_utils -q\n", "!pip install \"accelerate>=1.1.0\"\n", "!pip install \"transformers==5.0.0rc0\"" ] }, { "cell_type": "code", "execution_count": null, "id": "79ea31ef-b7f6-4dc2-a3c7-68dcac911809", "metadata": {}, "outputs": [], "source": [ "# For Flash Attention 2, requires a GPU with Ampere micro-architecture or higher\n", "!pip install --upgrade \"flash-attn>=2.6.3,<3.0.0\" --no-build-isolation" ] }, { "cell_type": "code", "execution_count": 6, "id": "5aa5c3bd", "metadata": {}, "outputs": [], "source": [ "import os, json\n", "import pandas as pd\n", "from datasets import load_dataset\n", "import numpy as np\n", "import io\n", "from IPython.display import display, HTML\n", "import base64\n", "\n", "import torch\n", "from transformers import AutoModel, AutoProcessor\n", "from transformers.image_utils import load_image\n", "from tqdm import tqdm\n", "import numpy as np\n", "import io\n", "from PIL import Image" ] }, { "cell_type": "markdown", "id": "a7517f08", "metadata": {}, "source": [ "## Loading a Vidore V3 dataset" ] }, { "cell_type": "markdown", "id": "08db4001-4064-4422-8d70-55f20fc661a8", "metadata": {}, "source": [ "Vidore V3 tasks are composed by three dataset types: queries, corpus and qrels." ] }, { "cell_type": "code", "execution_count": 7, "id": "4a00c6e5", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "DatasetDict({\n", " test: Dataset({\n", " features: ['query_id', 'query', 'language', 'query_types', 'query_format', 'content_type', 'raw_answers', 'query_generator', 'query_generation_pipeline', 'source_type', 'query_type_for_generation', 'answer'],\n", " num_rows: 1908\n", " })\n", "})" ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "queries = load_dataset(\"vidore/vidore_v3_hr\", \"queries\")\n", "queries" ] }, { "cell_type": "code", "execution_count": 8, "id": "e5dc37b8", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "{'query_id': 0,\n", " 'query': 'What impact did the shifts in temporary contract usage from 2018 to 2023 have on the difference in employment stability between mobile EU workers and citizens of the host countries?',\n", " 'language': 'english',\n", " 'query_types': ['multi-hop'],\n", " 'query_format': 'question',\n", " 'content_type': ['Chart', 'Table', 'Text'],\n", " 'raw_answers': ['From 2018 to 2023, the job stability gap between mobile EU workers and nationals narrowed. The use of temporary contracts declined more for EU movers (from 19% to 14%) than for nationals (14% to 11%), reducing the difference between the two groups from 5 to 3 percentage points.'],\n", " 'query_generator': 'sdg',\n", " 'query_generation_pipeline': 'gretel',\n", " 'source_type': 'summary',\n", " 'query_type_for_generation': 'multi-hop',\n", " 'answer': 'From 2018 to 2023, the job stability gap between mobile EU workers and nationals narrowed. The use of temporary contracts declined more for EU movers (from 19% to 14%) than for nationals (14% to 11%), reducing the difference between the two groups from 5 to 3 percentage points.'}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "queries['test'][0]" ] }, { "cell_type": "code", "execution_count": 9, "id": "20313f48", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "DatasetDict({\n", " test: Dataset({\n", " features: ['query_id', 'corpus_id', 'score', 'content_type', 'bounding_boxes'],\n", " num_rows: 10386\n", " })\n", "})" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "qrels = load_dataset(\"vidore/vidore_v3_hr\", \"qrels\")\n", "qrels" ] }, { "cell_type": "code", "execution_count": 10, "id": "60cd1f47", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "{'query_id': 0,\n", " 'corpus_id': 372,\n", " 'score': 1,\n", " 'content_type': ['Text'],\n", " 'bounding_boxes': [{'annotator': 0,\n", " 'x1': 216,\n", " 'x2': 1439,\n", " 'y1': 802,\n", " 'y2': 1013}]}" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "qrels['test'][0]" ] }, { "cell_type": "code", "execution_count": 11, "id": "093b9000", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "DatasetDict({\n", " test: Dataset({\n", " features: ['corpus_id', 'image', 'doc_id', 'markdown', 'page_number_in_doc'],\n", " num_rows: 1110\n", " })\n", "})" ] }, "execution_count": 11, "metadata": {}, "output_type": "execute_result" } ], "source": [ "corpus = load_dataset(\"vidore/vidore_v3_hr\", \"corpus\")\n", "corpus" ] }, { "cell_type": "code", "execution_count": 12, "id": "96f16676", "metadata": {}, "outputs": [], "source": [ "corpus_df = corpus[\"test\"].to_pandas()" ] }, { "cell_type": "code", "execution_count": 13, "id": "468e991e", "metadata": {}, "outputs": [], "source": [ "def get_corpus_sample(corpus_idx):\n", " return corpus['test'][corpus_idx]" ] }, { "cell_type": "markdown", "id": "e86dbd75", "metadata": {}, "source": [ "## Sampling a query" ] }, { "cell_type": "code", "execution_count": 14, "id": "c234d63f", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "{'query_id': 28,\n", " 'query': 'List the number of EU countries that ratified ILO Convention C189 by 2024 as mentioned in the text.',\n", " 'language': 'english',\n", " 'query_types': ['extractive', 'numerical'],\n", " 'query_format': 'instruction',\n", " 'content_type': ['Table', 'Text'],\n", " 'raw_answers': ['The nine EU countries ratified ILO Convention C189 by 2024, as mentioned in the text.'],\n", " 'query_generator': 'sdg',\n", " 'query_generation_pipeline': 'custom_pipeline',\n", " 'source_type': 'summary',\n", " 'query_type_for_generation': 'extractive',\n", " 'answer': 'Nine EU countries ratified ILO Convention C189 by 2024.'}" ] }, "execution_count": 14, "metadata": {}, "output_type": "execute_result" } ], "source": [ "# Samples an arbitrary query\n", "SAMPLED_QUERY_ID = 28\n", "sampled_query = queries[\"test\"][SAMPLED_QUERY_ID]\n", "sampled_query" ] }, { "cell_type": "markdown", "id": "e31233d6", "metadata": {}, "source": [ "### Positive (ground-truth pages) from the sampled query\n", "Lists the pages that have been annotated as relevant to the sampled query" ] }, { "cell_type": "code", "execution_count": 15, "id": "11f2a3dc", "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
query_idcorpus_idscorecontent_typebounding_boxes
3283102[Text][{'annotator': 0, 'x1': 178, 'x2': 1479, 'y1':...
0282551[Text][{'annotator': 0, 'x1': 183, 'x2': 1520, 'y1':...
1282611[Table, Text][{'annotator': 0, 'x1': 488, 'x2': 1445, 'y1':...
2283041[Text][{'annotator': 0, 'x1': 194, 'x2': 1472, 'y1':...
\n", "
" ], "text/plain": [ " query_id corpus_id score content_type \\\n", "3 28 310 2 [Text] \n", "0 28 255 1 [Text] \n", "1 28 261 1 [Table, Text] \n", "2 28 304 1 [Text] \n", "\n", " bounding_boxes \n", "3 [{'annotator': 0, 'x1': 178, 'x2': 1479, 'y1':... \n", "0 [{'annotator': 0, 'x1': 183, 'x2': 1520, 'y1':... \n", "1 [{'annotator': 0, 'x1': 488, 'x2': 1445, 'y1':... \n", "2 [{'annotator': 0, 'x1': 194, 'x2': 1472, 'y1':... " ] }, "execution_count": 15, "metadata": {}, "output_type": "execute_result" } ], "source": [ "# Positive pages\n", "sampled_qrels = qrels['test'].filter(lambda x: x['query_id'] == SAMPLED_QUERY_ID).to_pandas().sort_values(\"score\", ascending=False)\n", "sampled_qrels" ] }, { "cell_type": "code", "execution_count": 14, "id": "1e1eaa11", "metadata": { "jupyter": { "source_hidden": true } }, "outputs": [], "source": [ "def display_image_and_text(pil_image, text, pixels=800):\n", " buffered = io.BytesIO()\n", " pil_image.thumbnail((pixels, pixels))\n", " pil_image.save(buffered, format=\"PNG\") # Save as PNG for universal web compatibility\n", " img_str = base64.b64encode(buffered.getvalue()).decode()\n", " img_html_src = f\"data:image/png;base64,{img_str}\"\n", "\n", " html_output = f\"\"\"\n", "
\n", "
\"A
\n", "
{text}
\n", "
\n", " \"\"\"\n", "\n", " display(HTML(html_output))" ] }, { "cell_type": "code", "execution_count": 88, "id": "b50cf0b6", "metadata": {}, "outputs": [ { "data": { "text/html": [ "

Query: List the number of EU countries that ratified ILO Convention C189 by 2024 as mentioned in the text.
Answer: Nine EU countries ratified ILO Convention C189 by 2024.
Doc Id: 310 - Score: 2

" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "
\"A
\n", "

Access for domestic workers to labour and social protection | Synthesis Report
9. Improving social protection and labour rights for domestic workers, including a better evidence base
This section draws on the proposals made by the ESPAN national experts for improving the social protection and labour rights of domestic workers, including a better evidence base (data and analysis) on the number of these workers, their socio-demographic characteristics, and their working and living conditions. Section 9.1 focuses on the 27 EU Member States and Section 9.2 on the 7 (potential) candidate countries.
9.1 EU Member States
This section is organised under seven main headings.
9.1.1 Improving enforcement of rules and professionalisation of the sector
Many domestic workers throughout the EU are adversely affected in terms of their social protectior and labour rights. It is important to promote and enforce full compliance with those rights.
This includes mandatory written employment contracts that outline wages, working hours anc conditions, in order to protect domestic workers, and in particular migrant domestic workers, frorr exploitation. The enforcement of minimum wage legislation for domestic workers (nationa legislations as well as Directive (EU) 2022/2041 on adequate minimum wages in the EU) is also ke) to ensuring fair and equitable pay, as well as ratification of ILO Convention C189 which, by Octobe 2024, has been ratified by only nine EU Member States. The Convention sets out vital safeguards fo making decent work a reality for domestic workers. Its ratification constitutes a political commitment to implement important legislative changes (when needed) to enhance the working and living conditions of domestic workers. Ratification, together with the adoption of a clear legal definition of domestic workers, where needed, will also help to raise awareness of the situation of domestic workers in the individual countries and will facilitate the required legislative changes.
A legal definition of domestic work may have an impact on social and labour protection coverage fol certain domestic workers. Member States could usefully consider reviewing their legal definition(s (or adopting one in the case of those who do not have one). In doing so, they should ensure that the definitions are broad enough, so as to include domestic workers in non-standard employment and ir self-employment. Minimum thresholds should also be set, to make sure that domestic workers are properly covered. As mentioned by the ILO (2022), \"some countries have extended coverage by revisiting the minimum thresholds contained in labour and social security law that resulted ir excluding domestic workers from their de facto ambit, that is with reference to their working hours (for example, the requirement to work more than 20 hours per week), earnings thresholds (the requirement to earn at least the minimum wage) and the requirement to sum up hours of work performed for multiple employers.\" (ILO, 2022, p. 53)
Public debates in many Member States underline the lack of professionalisation and training in the domestic work sector, which may result in poor quality of household-related services. It is importani that countries consider implementing a robust professionalisation framework (if they do not already have one) which includes mandatory basic qualifications and comprehensive training programmes This is particularly important regarding caregivers, to help achieve a consistent standard of care Additionally, establishing a certification system to validate and recognise the skills of domestic workers will facilitate their access to higher-quality employment opportunities and encourage a more skilled workforce in the sector.
Improving compliance and facilitating inspections of private households are also key to improving the situation of domestic workers. It may be necessary to adapt legal and practical mechanisms to allow inspections at workplaces for domestic workers, or to find other effective ways to monitor the working

\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "\n", "\n" ] }, { "data": { "text/html": [ "

Query: List the number of EU countries that ratified ILO Convention C189 by 2024 as mentioned in the text.
Answer: Nine EU countries ratified ILO Convention C189 by 2024.
Doc Id: 255 - Score: 1

" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "
\"A
\n", "

Access for domestic workers to labour and social protection | Synthesis Report
These include:
\"geronto-housewives\" (i.e. trained persons employed on fixed-term contracts providing care to older people) as well as carers employed by centres for social welfare, carers employed by residential homes and carers employed by healthcare institutions, who are all covered by the Social Care Act 2022 and enjoy all the rights provided by Croatian employment law;
personal assistants of people with disabilities, who are covered by the Personal Assistant Act 2023 (which does not define the employment status of personal assistants); and self-employed carers providing private care in the home and not protected by employment law.
In Finland, the 1987 Act on Disability Services and Assistance contains provisions on the role of personal assistants who assist severely disabled persons at home and outside the home. Personal assistants are considered employees (as defined in the Employment Contracts Act). The employer can be the disabled person, the well-being service county, or a private service provider selling services to the county. As personal assistants are employees, they fall under the general labour legislation.
In Germany, the legislation on domestic workers and specific general provisions on LTC apply to individual carers commissioned and paid by the person in need of care or by their family. The Working Time Act exempts persons who are employed \"for the treatment, care and supervision of persons\" from the ban on working on Sundays and public holidays. However, according to a ruling of the Federal Labour Court, live-in care workers providing 24-hour care are also entitled to the statutory minimum wage, even during standby hours.
In Luxembourg, domestic paid carers who are part of a \"Support and care network\" are covered by the SAS Collective Agreement (1999). The LTC workers only provide their services during certain hours per week in the care receiver's home. They provide a set of professional home services to a client, and, more specifically, all assistance and care is covered by that person's LTC insurance.
In Slovenia, the Personal Assistance Act (2017) and the Act Amending the Personal Assistance Act (2021) regulate the right to personal assistance and the service provision. The Social Assistance Act (1992) and the Rules on Norms and Standards for Social Services (2010) form the legal framework for home-help workers in the public sector. Social assistance services that are not part of the public service network can be provided by legal entities and individuals provided they have obtained a revocable work permit issued by the Ministry of Solidarity- Rased Fu Eutuu
2.2.3 International Labour Organization Convention C189
The adoption of ILO Convention C189 (2011) represents a significant advance in domestic workers' labour rights at international level (ILO, 2021a). Nevertheless, despite the adoption of the Convention, many domestic workers continue to be adversely affected in terms of their labour and social protection rights (European Commission, 2021).
To date, ILO Convention C189 has been ratified by only nine EU Member States (BE, DE, ES, Fl, IE, IT, MT, PT, SE).

\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "\n", "\n" ] }, { "data": { "text/html": [ "

Query: List the number of EU countries that ratified ILO Convention C189 by 2024 as mentioned in the text.
Answer: Nine EU countries ratified ILO Convention C189 by 2024.
Doc Id: 261 - Score: 1

" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "
\"A
\n", "

| Access for domestic workers to labour and social protection Synthesis Report | Access for domestic workers to labour and social protection Synthesis Report |
| Table 2.1: Legal framework related to domestic workers: summary table | |
| Legal definition | |
| No legal definition | BG, CY, CZ, DE, DK, EE, HR, IE, LT, LV, PL, SI, SK |
| Single legal definition | EL', ES, FI, FR, HU, IT, MT, NL, PT, SE |
| Covering only salaried domestic workers | EL, HU, MT, NL |
| Covering salaried and self-employed domestic workers | ES, SE |
| All domestic workers including third party | FI, FR, IT, PT |
| Multiple legal definitions | AT, BE, LU, RO |
| | Overall legal framework |
| Same rules as the other workers | BG, CZ, DK, EE, HR, LT, LV, SK |
| Same rules with some exceptions | DE, EL, FI, FR, IE, LU, MT, PL, SI |
| Specific regulations applied to domestic workers | AT, BE, CY, ES, HU, IT, NL, PT, RO, SE |
| | Legislation specifically related to LTC |
| No legal considerations | AT2, BE, BG, CY, CZ, DK, EE, EL, ES, FR, IE, IT, LV, MT, NL, PL, PT, SE, SK |
| Specific legal provisions | AT3, DE, FI, HR, HU, LT, LU, RO, SI |
| | International Labour Organisation Convention C189 |
| Ratified | BE, DE, ES, FI, IE, IT, MT, PT, SE |
| Not ratified | AT, BG, CY, CZ, DK, EE, EL, FR, HR, HU, LT, LU, LV, NL, PL, RO, SI, SK |
| | Collective agreements |
| Collective agreements (also) for domestic workers | BE, DK, FI, FR, IT, SE |
| Broader collective agreements on social services covering domestic workers | AT4, ES*, LT, LU, LV, NL, PT, SI |
| Collective agreements covering only (some groups of) LTC domestic workers | BG,, CZ\", DE\", EES, HR, IE10 RO11 |
| Binding collective agreements in the domestic work sector, only when an intermediary is involved | ESS, MT |
| Collective agreements are impossible in practice | CY, EL |
| No collective agreements covering domestic workers | HU, PL, SK |
| Notes: there is no explicit national definition of domestic work, but a de facto definition is derived from the existing legal framework: labour institutional (not-for-profit as for social protection; 'ss for law; 'for employees of private as well as for-profit) ES collective whole service providers; appears in two categories of agreements; not in the country; under certain conditions (see above); for workers providing services the LTC scheme; ffrr workers the under insurance in healthcare 10 for home workers; !! for assistants professional personal assistants for sector; care personal and persons with disabilities employed by local county public services (agreements not present in the entire country). or Source: Authors' elaboration based the ESPAN national reports. own on | |

\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "\n", "\n" ] }, { "data": { "text/html": [ "

Query: List the number of EU countries that ratified ILO Convention C189 by 2024 as mentioned in the text.
Answer: Nine EU countries ratified ILO Convention C189 by 2024.
Doc Id: 304 - Score: 1

" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "
\"A
\n", "

Access for domestic workers to labour and social protection | Synthesis Report
Introduction
European Union policy context
increasing attention naas recentyy veen palu LO une situation oI domestic workers at European union (EU) level. The European Parliament, social partners and stakeholders have called on the European Commission to improve the working conditions and social protection of domestic workers within the limits of its Treaty competence.
Domestic workers provide support services to households, including care (e.g. childcare or long-term care (LTC) for older people and for people with disabilities) and non-care activities (e.g. cleaning or cooking). At EU level, the concept of \"domestic workers\" has, for a decade, often been approached through the wider concept of \"personal and household services (PHS) workers\".
Domestic workers are often hired in non-standard forms of employment (including part-time, temporary employment and platform work), with frequently more limited access to social and labour protection. In some countries, self-employment is also widespread in the sector. In addition, undeclared work is an overarching issue among domestic workers, which undermines the social and labour protection rights of the workers concerned.
Domestic work involves professions that are often listed as subject to shortages; for example, LTC workers. Domestic workers often acquire skills through their hands-on tasks, but it remains a challenge to have these skills validated and certified to facilitate access to more qualified work.
Domestic workers fall within the scope of the 2019 Council Recommendation on access to social protection which covers all individuals in employment, whether employees or self-employed (hereafter referred to as the \"2019 Council Recommendation\"). However, only limited measures targeted at this group have been amoonceddimplementte at national level since 2019. Domestic workers are also targeted by the 2022 Council Recommendation on access to high-quality affordable long-term care, which calls on Member States to address the challenges of vulnerable groups of workers, such as domestic LTC workers, live-in care workers and foreign (EU or non-EU) care workers, including by providing for effective regulation and professionalisation of such care work.
The International Labour Organization \"Domestic Workers Convention\" (ILO Convention C189 of 2011 calls on countries to provide domestic workers with fair recruitment and working conditions: the right to treatment equal to that of other workers; daily and weekly (at least 24 hours) rest hours; entitlement to a minimum wage; entitlement to representation of their interests; and the right to choose the place where they live and spend their leave. The Commission has, on several occasions, called on Member States to ratify this Convention. However, ratification has been subject to delays, with only nine Member States having ratified it' to date; and some of those facing problems of innlementation
A study by the European Social Policy Analysis Network (ESPAN)
The European Commission asked the European Social Policy Analysis Network (ESPAN) to assess the extent to which domestic workers have access to labour and social protection in 34 European countries: the 27 EU Member States as well as 7 (potential) candidate countries (Albania, Bosnia and Herzegovina, Moldova, Montenegro, North Macedonia, Serbia and Kosovo).
These countries are Italy and Germany (ratification in 2013), Ireland (2014), Belgium, Finland and Portugal (2015), Sweden (2019), Malta (2021) and Spain (2023).
2 The ESPAN covers 39 European countries: (a) the 27 EU Member States; (b) the 10 (potential) candidate countries, i.e. the six Western Balkan countries covered by the network (Albania, Bosnia and Herzegovina, Montenegro, North Macedonia, Serbia and Kosovo [the designation of the latter is without prejudice to positions on status, and is in line with UNSCR 1244 and the International Court of Justice Opinion on the Kosovo Declaration of Independence]) as well as Georgia, Moldova,

\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "\n", "\n" ] } ], "source": [ "# Displays the relevant pages\n", "for idx, row in sampled_qrels.iterrows():\n", " display(HTML(f'

Query: {sampled_query[\"query\"]}
Answer: {sampled_query[\"answer\"]}
'\n", " f'Doc Id: {row[\"corpus_id\"]} - Score: {row[\"score\"]}

'))\n", " corpus_sample = corpus['test'][int(row[\"corpus_id\"])]\n", " thumbnail_image = corpus_sample['image']\n", " text = '

' + corpus_sample['markdown'].replace(\"\\n\", \"
\") + '

' \n", " display_image_and_text(thumbnail_image, text)\n", " print()\n", " print()" ] }, { "cell_type": "markdown", "id": "1149a23a", "metadata": {}, "source": [ "## Embedding the pages corpus" ] }, { "cell_type": "markdown", "id": "4bf897d6-dbea-462d-9ebf-78a3b83276df", "metadata": {}, "source": [ "### Loads the model from HF Hub" ] }, { "cell_type": "code", "execution_count": 4, "id": "e36bceaf-06ad-43ef-9879-76a53e6fc54f", "metadata": {}, "outputs": [], "source": [ "model_name_or_path = \"nvidia/nemotron-colembed-vl-4b-v2\"\n", "## You can also try ColEmbed VL 8b v2\n", "#model_name_or_path = \"nvidia/nemotron-colembed-vl-8b-v2\"" ] }, { "cell_type": "code", "execution_count": 18, "id": "59968a5b", "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "Loading weights: 100%|██████████| 714/714 [00:02<00:00, 275.47it/s, Materializing param=model.visual.pos_embed.weight] \n", "The tied weights mapping and config for this model specifies to tie model.language_model.embed_tokens.weight to lm_head.weight, but both are present in the checkpoints, so we will NOT tie them. You should update the config with `tie_word_embeddings=False` to silence this warning\n" ] } ], "source": [ "device = \"cuda\" if torch.cuda.is_available() else \"cpu\"\n", "\n", "model = AutoModel.from_pretrained(\n", " model_name_or_path,\n", " torch_dtype=torch.bfloat16,\n", " trust_remote_code=True,\n", " device_map=\"auto\",\n", " # FlashAttention 2 requires an NVIDIA GPU with Ampere micro-architecture or later. If not available, comment next line.\n", " attn_implementation=\"flash_attention_2\", \n", ").eval()" ] }, { "cell_type": "markdown", "id": "93f24152", "metadata": {}, "source": [ "### Embedding pages from their images" ] }, { "cell_type": "code", "execution_count": 16, "id": "f40c9ef5", "metadata": {}, "outputs": [], "source": [ "# Breaking pages into batches\n", "BATCH_SIZE = 4\n", "corpus_batches = [corpus_df[i:i + BATCH_SIZE] for i in range(0, len(corpus_df), BATCH_SIZE)]" ] }, { "cell_type": "code", "execution_count": null, "id": "4d7423d8", "metadata": { "scrolled": true }, "outputs": [], "source": [ "%%time\n", "# Embedding pages from their image\n", "page_image_embeddings_list = []\n", "with torch.inference_mode():\n", " for batch in tqdm(corpus_batches):\n", " images = [Image.open(io.BytesIO(image_bytes[\"bytes\"])) for image_bytes in batch['image']]\n", " embeddings = model.forward_images(images=images)\n", " page_image_embeddings_list.append(embeddings)\n", "page_image_embeddings = torch.vstack(page_image_embeddings_list)\n", "page_image_embeddings.shape" ] }, { "cell_type": "markdown", "id": "cb0b952d", "metadata": {}, "source": [ "Uncomment the next cell to save the embeddings to disk as a numpy array if needed." ] }, { "cell_type": "code", "execution_count": 18, "id": "4fca9be2", "metadata": {}, "outputs": [], "source": [ "# page_image_embeddings_np = (\n", "# page_image_embeddings\n", "# .detach()\n", "# .cpu()\n", "# .float() # ← convert bfloat16 → float32\n", "# .numpy()\n", "# )\n", "# np.save(\"page_image_embeddings.npy\", page_image_embeddings_np)" ] }, { "cell_type": "markdown", "id": "64ddfe7d", "metadata": {}, "source": [ "## Retrieving pages for a query\n", "Uses the embeddings to retrieves the top-k page images more relevant to the query" ] }, { "cell_type": "code", "execution_count": 26, "id": "1fe761fd", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "List the number of EU countries that ratified ILO Convention C189 by 2024 as mentioned in the text.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "Extracting query embeddings...: 100%|██████████| 1/1 [00:05<00:00, 5.80s/it]\n" ] }, { "data": { "text/plain": [ "torch.Size([1, 39, 2560])" ] }, "execution_count": 26, "metadata": {}, "output_type": "execute_result" } ], "source": [ "query = sampled_query[\"query\"]\n", "print(query)\n", "\n", "# Embed the query\n", "with torch.inference_mode():\n", " queries_embeddings = model.forward_queries([query] , batch_size=8)\n", "queries_embeddings.shape" ] }, { "cell_type": "markdown", "id": "9ab909ed", "metadata": {}, "source": [ "### Retrieve pages" ] }, { "cell_type": "code", "execution_count": 82, "id": "01a66d79", "metadata": {}, "outputs": [], "source": [ "def get_sorted_top_k_retrieved_corpus_ids(docs_embeddings):\n", " device = next(model.parameters()).device\n", " # Computes MaxSim between the query embeddings and document embeddings\n", " sim_scores = model.get_scores(queries_embeddings, docs_embeddings)\n", " \n", " # Flatten logits to 1D array (handle both [batch_size] and [batch_size, 1] shapes)\n", " sim_scores_flat = sim_scores.flatten()\n", " \n", " # Get sorted indices (highest to lowest)\n", " sorted_indices = torch.argsort(sim_scores_flat, descending=True).cpu().numpy()\n", " sorted_sim_scores = sim_scores_flat[sorted_indices].cpu().float().numpy()\n", "\n", " return sorted_indices, sorted_sim_scores" ] }, { "cell_type": "code", "execution_count": 83, "id": "89f4fed5", "metadata": {}, "outputs": [], "source": [ "def display_retrieved_pages(retrieved_docs_df, topk=5, max_pixels=800):\n", " for idx, row in retrieved_docs_df[:topk].iterrows():\n", " display(HTML(f'

Query: {sampled_query[\"query\"]}
Answer: {sampled_query[\"answer\"]}

'\n", " f'Doc Id: {int(row[\"doc_id\"])} - Score: {row[\"score\"]}

'))\n", " corpus_sample = get_corpus_sample(int(row[\"doc_id\"]))\n", " thumbnail_image = corpus_sample['image']\n", " text = '

' + corpus_sample['markdown'].replace(\"\\n\", \"
\") + '

' \n", " display_image_and_text(thumbnail_image, text, pixels=max_pixels)\n", " print()\n", " print()" ] }, { "cell_type": "code", "execution_count": 90, "id": "8eb7e752-25c5-44fe-ba25-eff3cf100dc0", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "array([255, 310, 231, 304, 686])" ] }, "execution_count": 90, "metadata": {}, "output_type": "execute_result" } ], "source": [ "sorted_indices_retrieved_pages_by_images, sorted_cos_sim_retrieved_pages_by_images = \\\n", " get_sorted_top_k_retrieved_corpus_ids(page_image_embeddings)\n", "sorted_indices_retrieved_pages_by_images[:5]" ] }, { "cell_type": "code", "execution_count": 72, "id": "d7e70f97-0c80-4679-a84f-ad8717a7de9a", "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
doc_idscore
025536.468807
131036.297958
223136.109818
330436.083572
468635.908669
530035.900711
626135.867767
768535.849392
823535.824432
923035.741138
\n", "
" ], "text/plain": [ " doc_id score\n", "0 255 36.468807\n", "1 310 36.297958\n", "2 231 36.109818\n", "3 304 36.083572\n", "4 686 35.908669\n", "5 300 35.900711\n", "6 261 35.867767\n", "7 685 35.849392\n", "8 235 35.824432\n", "9 230 35.741138" ] }, "execution_count": 72, "metadata": {}, "output_type": "execute_result" } ], "source": [ "retrieved_docs_by_image_df = pd.DataFrame({\"doc_id\": sorted_indices_retrieved_pages_by_images, \n", " \"score\": sorted_cos_sim_retrieved_pages_by_images\n", " })\n", "retrieved_docs_by_image_df[:10]" ] }, { "cell_type": "code", "execution_count": null, "id": "380f6bb7-774a-46a8-94eb-2990cad8714e", "metadata": {}, "outputs": [], "source": [ "def recall_at_k(retrieved_top_k, gt_pages, topk=5):\n", " return len(set(retrieved_top_k[:topk]).intersection(set(gt_pages))) / len(gt_pages)" ] }, { "cell_type": "code", "execution_count": 81, "id": "e3864b84-f932-4907-8068-3d345391119a", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Recall@5 retrieving pages by image: 0.75\n" ] } ], "source": [ "recall_image_retrieval = recall_at_k(sorted_indices_retrieved_pages_by_images, gt_pages=sampled_qrels['corpus_id'], topk=5)\n", "print(f\"Recall@5 retrieving pages by image: {recall_image_retrieval}\")" ] }, { "cell_type": "markdown", "id": "093bc0ed", "metadata": {}, "source": [ "### Displaying top-5 retrieved pages\n", "(positive pages in blue, negative pages in red)" ] }, { "cell_type": "code", "execution_count": 76, "id": "8e9c85b9", "metadata": {}, "outputs": [ { "data": { "text/html": [ "

Query: List the number of EU countries that ratified ILO Convention C189 by 2024 as mentioned in the text.
Answer: Nine EU countries ratified ILO Convention C189 by 2024.

Doc Id: 255 - Score: 36.468807220458984

" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "
\"A
\n", "

Access for domestic workers to labour and social protection | Synthesis Report
These include:
\"geronto-housewives\" (i.e. trained persons employed on fixed-term contracts providing care to older people) as well as carers employed by centres for social welfare, carers employed by residential homes and carers employed by healthcare institutions, who are all covered by the Social Care Act 2022 and enjoy all the rights provided by Croatian employment law;
personal assistants of people with disabilities, who are covered by the Personal Assistant Act 2023 (which does not define the employment status of personal assistants); and self-employed carers providing private care in the home and not protected by employment law.
In Finland, the 1987 Act on Disability Services and Assistance contains provisions on the role of personal assistants who assist severely disabled persons at home and outside the home. Personal assistants are considered employees (as defined in the Employment Contracts Act). The employer can be the disabled person, the well-being service county, or a private service provider selling services to the county. As personal assistants are employees, they fall under the general labour legislation.
In Germany, the legislation on domestic workers and specific general provisions on LTC apply to individual carers commissioned and paid by the person in need of care or by their family. The Working Time Act exempts persons who are employed \"for the treatment, care and supervision of persons\" from the ban on working on Sundays and public holidays. However, according to a ruling of the Federal Labour Court, live-in care workers providing 24-hour care are also entitled to the statutory minimum wage, even during standby hours.
In Luxembourg, domestic paid carers who are part of a \"Support and care network\" are covered by the SAS Collective Agreement (1999). The LTC workers only provide their services during certain hours per week in the care receiver's home. They provide a set of professional home services to a client, and, more specifically, all assistance and care is covered by that person's LTC insurance.
In Slovenia, the Personal Assistance Act (2017) and the Act Amending the Personal Assistance Act (2021) regulate the right to personal assistance and the service provision. The Social Assistance Act (1992) and the Rules on Norms and Standards for Social Services (2010) form the legal framework for home-help workers in the public sector. Social assistance services that are not part of the public service network can be provided by legal entities and individuals provided they have obtained a revocable work permit issued by the Ministry of Solidarity- Rased Fu Eutuu
2.2.3 International Labour Organization Convention C189
The adoption of ILO Convention C189 (2011) represents a significant advance in domestic workers' labour rights at international level (ILO, 2021a). Nevertheless, despite the adoption of the Convention, many domestic workers continue to be adversely affected in terms of their labour and social protection rights (European Commission, 2021).
To date, ILO Convention C189 has been ratified by only nine EU Member States (BE, DE, ES, Fl, IE, IT, MT, PT, SE).

\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "\n", "\n" ] }, { "data": { "text/html": [ "

Query: List the number of EU countries that ratified ILO Convention C189 by 2024 as mentioned in the text.
Answer: Nine EU countries ratified ILO Convention C189 by 2024.

Doc Id: 310 - Score: 36.29795837402344

" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "
\"A
\n", "

Access for domestic workers to labour and social protection | Synthesis Report
9. Improving social protection and labour rights for domestic workers, including a better evidence base
This section draws on the proposals made by the ESPAN national experts for improving the social protection and labour rights of domestic workers, including a better evidence base (data and analysis) on the number of these workers, their socio-demographic characteristics, and their working and living conditions. Section 9.1 focuses on the 27 EU Member States and Section 9.2 on the 7 (potential) candidate countries.
9.1 EU Member States
This section is organised under seven main headings.
9.1.1 Improving enforcement of rules and professionalisation of the sector
Many domestic workers throughout the EU are adversely affected in terms of their social protectior and labour rights. It is important to promote and enforce full compliance with those rights.
This includes mandatory written employment contracts that outline wages, working hours anc conditions, in order to protect domestic workers, and in particular migrant domestic workers, frorr exploitation. The enforcement of minimum wage legislation for domestic workers (nationa legislations as well as Directive (EU) 2022/2041 on adequate minimum wages in the EU) is also ke) to ensuring fair and equitable pay, as well as ratification of ILO Convention C189 which, by Octobe 2024, has been ratified by only nine EU Member States. The Convention sets out vital safeguards fo making decent work a reality for domestic workers. Its ratification constitutes a political commitment to implement important legislative changes (when needed) to enhance the working and living conditions of domestic workers. Ratification, together with the adoption of a clear legal definition of domestic workers, where needed, will also help to raise awareness of the situation of domestic workers in the individual countries and will facilitate the required legislative changes.
A legal definition of domestic work may have an impact on social and labour protection coverage fol certain domestic workers. Member States could usefully consider reviewing their legal definition(s (or adopting one in the case of those who do not have one). In doing so, they should ensure that the definitions are broad enough, so as to include domestic workers in non-standard employment and ir self-employment. Minimum thresholds should also be set, to make sure that domestic workers are properly covered. As mentioned by the ILO (2022), \"some countries have extended coverage by revisiting the minimum thresholds contained in labour and social security law that resulted ir excluding domestic workers from their de facto ambit, that is with reference to their working hours (for example, the requirement to work more than 20 hours per week), earnings thresholds (the requirement to earn at least the minimum wage) and the requirement to sum up hours of work performed for multiple employers.\" (ILO, 2022, p. 53)
Public debates in many Member States underline the lack of professionalisation and training in the domestic work sector, which may result in poor quality of household-related services. It is importani that countries consider implementing a robust professionalisation framework (if they do not already have one) which includes mandatory basic qualifications and comprehensive training programmes This is particularly important regarding caregivers, to help achieve a consistent standard of care Additionally, establishing a certification system to validate and recognise the skills of domestic workers will facilitate their access to higher-quality employment opportunities and encourage a more skilled workforce in the sector.
Improving compliance and facilitating inspections of private households are also key to improving the situation of domestic workers. It may be necessary to adapt legal and practical mechanisms to allow inspections at workplaces for domestic workers, or to find other effective ways to monitor the working

\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "\n", "\n" ] }, { "data": { "text/html": [ "

Query: List the number of EU countries that ratified ILO Convention C189 by 2024 as mentioned in the text.
Answer: Nine EU countries ratified ILO Convention C189 by 2024.

Doc Id: 231 - Score: 36.10981750488281

" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "
\"A
\n", "

Access for domestic workers to labour and social protection | Synthesis Report
A2. The legal status of domestic workers in the EU varies considerably, reflecting the different legal frameworks in the Member States
According to ESPAN national experts, in 13 Member States, there is no legal definition of domestic workers in national legislation. In 10 Member States, domestic workers are covered by a single legal definition, covering either only employees, or employees and the self-employed, or all categories of domestic workers regardless of the form of employment; in some of these countries, certain categories are excluded from the national definition(s) of domestic workers. In four Member States there are various regulations on the employment of domestic workers, each with a specific definition of domestic work(er)
A3. In 19 Member States, the rules of labour law and social protection applying to domestic workers (in declared employment) differ from those applying to other workers
propori limited access to social protection and labour protection.
o or only very nign proportion or domestic workers are undeciared or unuerrdeciared, so nave no unueciared
In eight Member States, domestic workers (in declared employment), whether employees or self- employed, are subject to the same rules of labour law and social protection as other workers, without any distinction. In nine Member States, the provisions of labour and social security law apply to domestic workers in the same way as to other workers, but with some exceptions (regarding, for instance, working time, rules on dismissal, additional legal obligations imposed on the employer). In the remaining 10 Member States, domestic work is subject to specific regulations governing, among other aspects, working time, remuneration, the termination of the work contract, the employer's obligations.
Nine Member States have legal provisions which apply specifically to domestic workers in long-term care (LTC).
A4. Only one third of the Member States have ratified the 2011 ILO Convention on Domestic Workers
To date, only nine Member States have ratified ILO Convention C189 on Domestic Workers, and in some of those countries, ESPAN national experts note specific implementation problems. ESPAN national experts in the 18 Member States which have not ratified it explain that there can be three main reasons for this. In most cases, it is simply due to the fact that the country is reluctant to make significant changes to its national regulatory framework. In some cases, the country is of the view that its legislation is already compliant with the Convention. Finally, in a minority of cases, the country considers that domestic workers are adequately protected by existing collective agreements.
A5. In almost all the Member States, collective agreements cover either all or certain groups of domestic workers
In six Member States, collective agreements play a major role, including for domestic workers. In the other Member States, the situation varies a great deal. In 15 Member States, domestic workers are covered by broader collective agreements on social services (8 countries) or there are collective agreements covering only (some of the) LTC domestic workers (7 countries). In two Member States collective agreements in the domestic sector are binding only if the worker is in contact with the household through an intermediary. Finally, in five Member States, there are no collective agreements covering domestic workers. 10
The total number of countries is equal to 28 rather than 27 because one Member State falls into two categories

\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "\n", "\n" ] }, { "data": { "text/html": [ "

Query: List the number of EU countries that ratified ILO Convention C189 by 2024 as mentioned in the text.
Answer: Nine EU countries ratified ILO Convention C189 by 2024.

Doc Id: 304 - Score: 36.08357238769531

" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "
\"A
\n", "

Access for domestic workers to labour and social protection | Synthesis Report
Introduction
European Union policy context
increasing attention naas recentyy veen palu LO une situation oI domestic workers at European union (EU) level. The European Parliament, social partners and stakeholders have called on the European Commission to improve the working conditions and social protection of domestic workers within the limits of its Treaty competence.
Domestic workers provide support services to households, including care (e.g. childcare or long-term care (LTC) for older people and for people with disabilities) and non-care activities (e.g. cleaning or cooking). At EU level, the concept of \"domestic workers\" has, for a decade, often been approached through the wider concept of \"personal and household services (PHS) workers\".
Domestic workers are often hired in non-standard forms of employment (including part-time, temporary employment and platform work), with frequently more limited access to social and labour protection. In some countries, self-employment is also widespread in the sector. In addition, undeclared work is an overarching issue among domestic workers, which undermines the social and labour protection rights of the workers concerned.
Domestic work involves professions that are often listed as subject to shortages; for example, LTC workers. Domestic workers often acquire skills through their hands-on tasks, but it remains a challenge to have these skills validated and certified to facilitate access to more qualified work.
Domestic workers fall within the scope of the 2019 Council Recommendation on access to social protection which covers all individuals in employment, whether employees or self-employed (hereafter referred to as the \"2019 Council Recommendation\"). However, only limited measures targeted at this group have been amoonceddimplementte at national level since 2019. Domestic workers are also targeted by the 2022 Council Recommendation on access to high-quality affordable long-term care, which calls on Member States to address the challenges of vulnerable groups of workers, such as domestic LTC workers, live-in care workers and foreign (EU or non-EU) care workers, including by providing for effective regulation and professionalisation of such care work.
The International Labour Organization \"Domestic Workers Convention\" (ILO Convention C189 of 2011 calls on countries to provide domestic workers with fair recruitment and working conditions: the right to treatment equal to that of other workers; daily and weekly (at least 24 hours) rest hours; entitlement to a minimum wage; entitlement to representation of their interests; and the right to choose the place where they live and spend their leave. The Commission has, on several occasions, called on Member States to ratify this Convention. However, ratification has been subject to delays, with only nine Member States having ratified it' to date; and some of those facing problems of innlementation
A study by the European Social Policy Analysis Network (ESPAN)
The European Commission asked the European Social Policy Analysis Network (ESPAN) to assess the extent to which domestic workers have access to labour and social protection in 34 European countries: the 27 EU Member States as well as 7 (potential) candidate countries (Albania, Bosnia and Herzegovina, Moldova, Montenegro, North Macedonia, Serbia and Kosovo).
These countries are Italy and Germany (ratification in 2013), Ireland (2014), Belgium, Finland and Portugal (2015), Sweden (2019), Malta (2021) and Spain (2023).
2 The ESPAN covers 39 European countries: (a) the 27 EU Member States; (b) the 10 (potential) candidate countries, i.e. the six Western Balkan countries covered by the network (Albania, Bosnia and Herzegovina, Montenegro, North Macedonia, Serbia and Kosovo [the designation of the latter is without prejudice to positions on status, and is in line with UNSCR 1244 and the International Court of Justice Opinion on the Kosovo Declaration of Independence]) as well as Georgia, Moldova,

\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "\n", "\n" ] }, { "data": { "text/html": [ "

Query: List the number of EU countries that ratified ILO Convention C189 by 2024 as mentioned in the text.
Answer: Nine EU countries ratified ILO Convention C189 by 2024.

Doc Id: 686 - Score: 35.908668518066406

" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "
\"A
\n", "

Joint Employment Report 2025
protection in the context of domestic work. The regula- tion specifies the list of rights of domestic workers and the duties of employers, providing the necessary legal certainty for their effectiveness. In April 2024, Bulgaria ratified fundamentaa ILO conventions C155 and C187 and, in October 2024, the Netherlands ratified C187 pertaining to occupational health and safety.
Some Member States have been taking measures to reduce the incidence of undeclared work. As part of its RRP, Greece is preparing the implementation of an IT system for labour market monitoring (ARIADNE), which will ensure the digital recording of working time and act as a single gateway for employment and social insurance administrative data. As of December 2023, the Italian Revenue Agency and the National Social Se- curity Institute are set to achieve full interoperability of their respective databases 5o as to tackle tax evasion in the domestic work sector. As of April 2024, as part of its RRP, Italy strengthened labour inspection activities and introduced deterrent and incentivising measure to reduce the incidence of undeclared work, In. 2024, in Lithuania, changes to the rules on mandatory debt col- lection entered into force, with the aim of incentivising more unemployed to return to the labour market and thus reduce the shadow economy Upon registering with the Public Emplayment Service, indebted unemployed can benefit of a periad of 5 months (available no more than twice during 5 years) during which no mandatory debt collection action is taken against them.
New working arrangements, such as flexible working, telework and remote work, are on the agenda of several Member States. Amendments to the Czech Labour Code entered into force in September 2023, with one of the key changes being the regulation of remote work. Also, parents of young children and caregivers have enhanced support to combine family life with work. Another novelty is the possibility to pro- vide remote workers with compensation for the most common costs related to their home office in the form of a flat rate. In Ireland, the Right to Request Remote Work Bill was integrated into the Work Life Balance and Miscellaneous Provisions Act, and the changes entered into force in March 2024. The Act includes workers' right to request remote work and carers' right to request flex- ible working, including the right to compressed or re- duced hours for breastfeeding mothers. As part of its RRP, Cyprus introduced in March 2024 a scheme to provide incentives for the employment of people that are unemployed by providing flexible forms of work through teleworking In March 2024, Bulgaria imple- mented a reform included in its RRP through which the rules on distance work established by the Labour Code were amended to facilitate access to remote work by providing legal certainty for workers and employers alike, clarifying the rules on health and safety and on monitoring and reporting of working time.
Member States continue to address long- -term un- employment through various targeted measures.
In Austria, the Springboard programme (launched in 2021 with the aim of combatting long-term unemploy- ment through subsidised employment either in social enterprises or through particularly favourable condi- tions for integration assistance) became part of the public employment service's regular budget as of 2023. In the same year, Portugal created an exceptional measure that allows the partial accumulation of unem-- ployment benefits with income from work, alming to en- courage the long term unemployed to return to the labour market In April 2024, Slovakia launched the na- tional project Financial Incentives for Employment in or- der to support the unemployed in a disadvantaged position due to age, complicated family situation, low education, loss of work habits, disability and other rea- sons. Between April and September 2024, Hungary launched a call for the Job Trial Pilot Programme aimed to address the labour needs of enterprises by increasing the domestic labour supply and promoting the employ- ment of the long term unemplayed. The participating SMES receive support not only for wages (for up to g months) but also to provide personalised development and mentoring to the long- term unemployed based on the assessment of their competences. The long term unemplayed receive an additional allowance (on top of their wages) as incentive to remain in employment, for up to 9 months. In 2023, Croatia launched a targeted active labour market policy programme (\"Job plus') for the long- term unemployed and vulnerable groups. De- pending on the distance from the labour market, it of- fers long term unemployed people a set of 2-3 measures (activation programme, work integration or/and upskillingtrainnng) to support their integration into the labour market.
Some Member States have taken legislative ac- tien to improve working conditions in platform work and tackle challenges resulting from the use of algorithmic management in the workspace. Changes to the Croatian Labour Act, which took effect on 1 January 2024 and are part of the RRP, specify that digital labour platforms and aggregators (intermediar ies connecting such platforms with workers) are jointly liable for salary payment to platform workers. They must inform platform workers of the work organization and decision-making processes and ensure the trans- parency of data As part of its RRP, Cyprus is reforming its social insurance to cover the self employed, and those in non-standard forms of employment, such as platform workers. In Germany, the goverment is cur- rently working on a specific employee data protection law which will, among others, deal with typical situi-- tions that arise in the context of algorithmic manage- ment in the workplace, such as video surveillance and the use of Al systems. Portugal recently introduced regulation on algorithmic management at work under the 2023 decent work agenda. The law stipulates, among others, that collective bargaining agreements can regulate the use of algorithms and artificial intelli- gence

\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "\n", "\n" ] } ], "source": [ "display_retrieved_pages(retrieved_docs_by_image_df)" ] } ], "metadata": { "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.10.12" } }, "nbformat": 4, "nbformat_minor": 5 }