{"id":171490,"date":"2023-09-29T09:27:38","date_gmt":"2023-09-29T08:27:38","guid":{"rendered":"https:\/\/datascientest.com\/en\/?p=171490"},"modified":"2023-10-30T20:24:01","modified_gmt":"2023-10-30T19:24:01","slug":"scikit-learn-discover-the-python-library-dedicated-to-machine-learning","status":"publish","type":"post","link":"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning","title":{"rendered":"Scikit Learn: Discover the Python library dedicated to Machine Learning"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"171490\" class=\"elementor elementor-171490\" data-elementor-post-type=\"post\">\n\t\t\t\t\t\t\t<div class=\"elementor-element elementor-element-0bed8e0 e-flex e-con-boxed e-con\" data-id=\"0bed8e0\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t<div class=\"elementor-element elementor-element-28b1038 e-con-full e-flex e-con\" data-id=\"28b1038\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;full&quot;}\">\n\t\t\t\t<div class=\"elementor-element elementor-element-9d94624 elementor-widget elementor-widget-heading\" data-id=\"9d94624\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-heading-title{padding:0;margin:0;line-height:1}.elementor-widget-heading .elementor-heading-title[class*=elementor-size-]>a{color:inherit;font-size:inherit;line-height:inherit}.elementor-widget-heading .elementor-heading-title.elementor-size-small{font-size:15px}.elementor-widget-heading .elementor-heading-title.elementor-size-medium{font-size:19px}.elementor-widget-heading .elementor-heading-title.elementor-size-large{font-size:29px}.elementor-widget-heading .elementor-heading-title.elementor-size-xl{font-size:39px}.elementor-widget-heading .elementor-heading-title.elementor-size-xxl{font-size:59px}<\/style><h2 class=\"elementor-heading-title elementor-size-default\">If you study data and want to derive information from it, you will often need to process the data, modify it and, above all, build models capable of learning patterns in your data for a chosen problem. There are a number of open source libraries available to do this, but the best-known of these is surely Scikit Learn.<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-35815e7 elementor-widget elementor-widget-heading\" data-id=\"35815e7\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">What is Sckikit Learn ?<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-bfcced1 elementor-widget elementor-widget-text-editor\" data-id=\"bfcced1\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-widget-text-editor.elementor-drop-cap-view-stacked .elementor-drop-cap{background-color:#69727d;color:#fff}.elementor-widget-text-editor.elementor-drop-cap-view-framed .elementor-drop-cap{color:#69727d;border:3px solid;background-color:transparent}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap{margin-top:8px}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap-letter{width:1em;height:1em}.elementor-widget-text-editor .elementor-drop-cap{float:left;text-align:center;line-height:1;font-size:50px}.elementor-widget-text-editor .elementor-drop-cap-letter{display:inline-block}<\/style>\t\t\t\t<p>It&#8217;s a <a href=\"https:\/\/datascientest.com\/en\/python-programming-for-beginners-episode-3\">Python library<\/a> that provides access to efficient implementations of many common algorithms. It also offers a <a href=\"https:\/\/datascientest.com\/en\/api-the-path-to-seamless-integration\">clean and consistent API.<\/a> Therefore, one of the big advantages of Scikit-Learn is that once you&#8217;ve understood the basic usage and syntax of Scikit-Learn for a type of model,<a href=\"https:\/\/datascientest.com\/en\/algorithm-what-is-it\"> transitioning to a new model or algorithm<\/a> is very straightforward. The library not only enables modeling but can also handle preprocessing steps, as we will see in the rest of the article.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-cdc7a51 elementor-widget elementor-widget-heading\" data-id=\"cdc7a51\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">History and purpose<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-9e5b91a elementor-widget elementor-widget-text-editor\" data-id=\"9e5b91a\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>The project was initially launched in 2007 by David Cournapeau, and quickly, many members of the <strong>Python scientific community<\/strong> rallied around it. The project progressed rapidly as part of work on functional brain imaging conducted by Inria. In 2009, the first version of Scikit-Learn was released. Since then, no less than forty versions have been released, leading to the current version, 0.24.1. This number reflects the dedication and work put into the project by developers around the world, with each version improving or adding innovative new statistical methods.<\/p><p>From the beginning, the goal was ambitious: to make the library easy to use on multiple platforms and to <strong>provide comprehensive documentation<\/strong> with concrete examples for each tool developed. Today, Scikit-Learn is one of the most popular libraries on GitHub. Due to the project&#8217;s initial goals, one of Scikit-Learn&#8217;s strengths is its flexibility and the ease with which you can use it for a wide range of tasks, such as customer segmentation, product recommendations, fraud detection, and more.<\/p><p>Lastly, it&#8217;s important to note that Scikit-Learn is an open-source project available to everyone under the BSD license. On the library&#8217;s website, you will find very detailed documentation of the available statistical methods, along with examples for understanding them, as well as practical cases for comparing different methods and gaining a better understanding of them.<\/p><p>\u00a0<\/p><p>\ud83d\udca1Related articles:<\/p><table dir=\"ltr\" border=\"1\" cellspacing=\"0\" cellpadding=\"0\"><colgroup><col width=\"656\" \/><\/colgroup><tbody><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Folium: Discover the open source Python library &quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/folium-discover-the-open-source-python-library\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/folium-discover-the-open-source-python-library\" target=\"_blank\" rel=\"noopener\">Folium: Discover the open source Python library <\/a><\/td><\/tr><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Matplotlib: Master Data Visualization in Python &quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/matplotlib-master-data-visualization-in-python\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/matplotlib-master-data-visualization-in-python\" target=\"_blank\" rel=\"noopener\">Matplotlib: Master Data Visualization in Python <\/a><\/td><\/tr><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Python Crash Course: Get started &quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/python-all-you-need-to-know\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/python-all-you-need-to-know\" target=\"_blank\" rel=\"noopener\">Python Crash Course: Get started <\/a><\/td><\/tr><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Mastering Machine Learning in Python: Data-Driven Success &quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/machine-learning-python-where-to-start\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/machine-learning-python-where-to-start\" target=\"_blank\" rel=\"noopener\">Mastering Machine Learning in Python: Data-Driven Success <\/a><\/td><\/tr><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Python Programming for Beginners - Episode 3&quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/python-programming-for-beginners-episode-3\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/python-programming-for-beginners-episode-3\" target=\"_blank\" rel=\"noopener\">Python Programming for Beginners &#8211; Episode 3<\/a><\/td><\/tr><\/tbody><\/table>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-44b1597 elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"44b1597\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Learn Scikit-Learn<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ace60c6 elementor-widget elementor-widget-html\" data-id=\"ace60c6\" data-element_type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<script type=\"application\/ld+json\">\n{\n  \"@context\": \"https:\/\/schema.org\",\n  \"@type\": \"FAQPage\",\n  \"mainEntity\": [{\n    \"@type\": \"Question\",\n    \"name\": \"What is Sckikit-Learn?\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"It's a Python library that provides access to efficient versions of many common algorithms. It also offers a clean, standardized API. As a result, one of the big advantages of Scikit-Learn is that once you've understood the basic use and syntax of Scikit-Learn for one type of model, switching to a new model or algorithm is very simple. The library not only allows you to do modeling, it can also handle preprocessing steps, which we'll see later in the article.\"\n    }\n  },{\n    \"@type\": \"Question\",\n    \"name\": \"Scikit-Learn API\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"It has been built according to certain principles so as to make it very easily applicable to a large number of domains\".\n    }\n  }]\n}\n<\/script>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-d167e3a elementor-widget elementor-widget-heading\" data-id=\"d167e3a\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">The Scikit learn API<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-51d26ad elementor-widget elementor-widget-text-editor\" data-id=\"51d26ad\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>It has been built based on certain principles to make it easily applicable to a wide range of domains:<\/p><ul><li><strong>Consistency:<\/strong> All objects share a common interface derived from a limited set of methods, with consistent documentation.<\/li><li><strong>Inspection:<\/strong> All specified parameter values are exposed as public attributes.<\/li><li><strong>Limited object hierarchy:<\/strong> Only algorithms are represented by Python classes; datasets are represented in standard formats (<a href=\"https:\/\/datascientest.com\/en\/numpy-the-python-library-in-data-science\">NumPy arrays,<\/a> Pandas DataFrames, SciPy sparse matrices), and parameter names use standard Python strings.<\/li><li><strong>Composition:<\/strong> Many machine learning tasks can be expressed as sequences of more fundamental algorithms, and Scikit-Learn makes use of this whenever possible.<\/li><li><strong>Reasonable default values:<\/strong> When models require user-specified parameters, the library defines appropriate default values. These principles are directly described in the paper outlining Scikit-Learn&#8217;s API principles.<\/li><\/ul><p>In practice, these five principles make it easy and seamless to use the library, even for individuals without a strong mathematical background.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-4ac4e1d elementor-widget elementor-widget-heading\" data-id=\"4ac4e1d\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Scikit Learn Basics<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-762ea2a elementor-widget elementor-widget-text-editor\" data-id=\"762ea2a\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><span style=\"font-weight: 400;\">Because the API is standardized, whatever model you plan to use, the modeling steps are often the same:<\/span><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-148b5e4 elementor-widget elementor-widget-image\" data-id=\"148b5e4\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-widget-image{text-align:center}.elementor-widget-image a{display:inline-block}.elementor-widget-image a img[src$=\".svg\"]{width:48px}.elementor-widget-image img{vertical-align:middle;display:inline-block}<\/style>\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"800\" height=\"439\" src=\"https:\/\/datascientest.com\/en\/files\/2021\/05\/illu_scikit_blog_2-09.png\" class=\"attachment-large size-large wp-image-73285\" alt=\"scikit learn\" srcset=\"https:\/\/datascientest.com\/en\/files\/2021\/05\/illu_scikit_blog_2-09.png 1024w, https:\/\/datascientest.com\/en\/files\/2021\/05\/illu_scikit_blog_2-09-300x165.png 300w, https:\/\/datascientest.com\/en\/files\/2021\/05\/illu_scikit_blog_2-09-768x422.png 768w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\"><\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ede4f00 elementor-widget elementor-widget-text-editor\" data-id=\"ede4f00\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<ul><li style=\"font-weight: 400;\" aria-level=\"1\"><p><strong>Choosing a model<\/strong> by importing the appropriate class from <strong>Scikit-Learn.<\/strong><\/p><p>Configuring the model. If you are already sure about the parameters you want to use, you can manually set them. Otherwise, the library also offers techniques like GridSearchCV to find optimal parameters.<\/p><\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><p><strong>Training the model<\/strong> on the training dataset using the fit method.<\/p><\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><p><strong>Testing the model on new data:<\/strong><br \/>&#8211; In supervised learning, we use the predict method on the test data.<br \/>&#8211; In unsupervised learning, we use the transform or predict methods.<\/p><\/li><\/ul><p>These four steps are generally common to using a large number of models available in the library, which means that once you understand the logic of constructing a model, you can easily use other models.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-be9d71c elementor-widget elementor-widget-heading\" data-id=\"be9d71c\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Scikit-Learn: a wealth of possibilities<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-d65f8e0 elementor-widget elementor-widget-image\" data-id=\"d65f8e0\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"800\" height=\"498\" src=\"https:\/\/datascientest.com\/en\/files\/2021\/05\/ml_map-1024x638.png\" class=\"attachment-large size-large wp-image-66436\" alt=\"Cheat sheet scikit learn\" srcset=\"https:\/\/datascientest.com\/en\/files\/2021\/05\/ml_map-1024x638.png 1024w, https:\/\/datascientest.com\/en\/files\/2021\/05\/ml_map-300x187.png 300w, https:\/\/datascientest.com\/en\/files\/2021\/05\/ml_map-768x479.png 768w, https:\/\/datascientest.com\/en\/files\/2021\/05\/ml_map-1536x958.png 1536w, https:\/\/datascientest.com\/en\/files\/2021\/05\/ml_map-2048x1277.png 2048w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\"><\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3e19dfa elementor-widget elementor-widget-text-editor\" data-id=\"3e19dfa\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>In a previous article, we discussed the <strong>5 crucial steps of a data project:<\/strong><\/p><p>1. Grasping the ins and outs.<br \/>2. Retrieving and exploring the data.<br \/>3. Preparing your working databases.<br \/>4. Selecting and training a model.<br \/>5. Evaluating your results.<\/p><p>In the last 3 steps, Scikit-Learn is a widely used library that provides you with all the necessary tools:<\/p><p>To prepare your data, the library offers an array of methods for:<\/p><ul><li>Splitting your data into training and testing sets using the `train_test_split` function.<\/li><li>Encoding categorical variables with methods like `OneHotEncoder`.<\/li><li>Normalizing the data before modeling using methods like `StandardScaler`.<\/li><li>Handling missing values with simple imputation methods like `SimpleImputer` or more advanced methods like `IterativeImputer`.<\/li><li>Conducting variable selection with methods like `SelectKBest`.<\/li><li>Reducing dimensionality using methods like PCA or TSNE.<\/li><\/ul><p>All these methods allow you to prepare the data effectively, a crucial step in a project, and <strong>Scikit-Learn<\/strong> provides all the necessary tools to succeed. We&#8217;ve mentioned just a small part of the available methods; you can find many more on the [<a href=\"https:\/\/scikit-learn.org\/stable\/index.html\">Scikit-Learn website<\/a>].<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-6d16f8d elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"6d16f8d\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/en\/data-courses\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Become a Data Scientist and learn Python<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-23f7a7e elementor-widget elementor-widget-heading\" data-id=\"23f7a7e\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Supervised and unsupervised learning on Scikit-Learn <\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-54e197a elementor-widget elementor-widget-text-editor\" data-id=\"54e197a\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><strong>Scikit-Learn<\/strong> covers two major types of learning for selecting and training models:<\/p><p><strong>1. Supervised Learning:<\/strong> Scikit-Learn provides a wide range of models such as logistic regression, linear regression, penalized linear regressions like Ridge, Lasso, or Elastic Net, decision trees, ensemble methods like random forests, and boosting methods. These models can be easily used for <a href=\"https:\/\/datascientest.com\/en\/management-of-unbalanced-classification-problems-i\">both classification and regression problems.<\/a><\/p><p><strong>2. Unsupervised Learning:<\/strong> In this category, Scikit-Learn <a href=\"https:\/\/datascientest.com\/en\/k-means-clustering-in-machine-learning-a-deep-dive\">offers algorithms like k-means, hierarchical clustering,<\/a> DBSCAN, Gaussian mixture models, and more, making it easy to work on unsupervised learning tasks.<\/p><p>For most of these models, especially in supervised learning, we don&#8217;t know in advance which parameters will yield the best performance. Therefore, <strong>Scikit Learn<\/strong> provides tools like GridSearchCV and RandomizedSearchCV, which use cross-validation to determine the best parameters for our models. These two functions are widely used in the data science community when modeling data.<\/p><p>The wide variety of models available in a single library makes <strong>Scikit Learn<\/strong> a must-have for the modeling phase of data projects.<\/p><p>When it comes to evaluating results, Scikit Learn excels as well. It offers no less than 40 readily available metrics for evaluating model results. Some, like RMSE, MAE, MSE, and r2_score, are used to assess and compare regression model results.<\/p><p>Others, like confusion_matrix, accuracy_score, classification_report, are used for classification models. Additionally, metrics like silhouette_score help evaluate the performance of <strong>partitioning algorithms such as hierarchical clustering.<\/strong><\/p><p>It&#8217;s also important to mention that Scikit-Learn, thanks to a method called the pipeline, allows you to instantiate the last three stages of a data project in very few lines of code.<\/p><p>Of course, this tool is used after testing different models and determining the best one for your problem.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-20d930c elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"20d930c\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/en\/data-courses\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Learn to use Scikit-Learn<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-b75b55a elementor-widget elementor-widget-heading\" data-id=\"b75b55a\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">A little practice<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-b6026c3 elementor-widget elementor-widget-text-editor\" data-id=\"b6026c3\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Let&#8217;s look at a concrete example to <strong>understand Scikit-Learn&#8217;s ability to provide statistical tools<\/strong> for a data project with minimal lines of code.<\/p><p>In this example, we will use the Boston house-prices dataset provided by the library. This dataset does not contain missing values, and our goal will be to test three different models, find the optimal parameters for each, and compare the scores obtained to determine the best one.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-a8f22cc elementor-widget elementor-widget-shortcode\" data-id=\"a8f22cc\" data-element_type=\"widget\" data-widget_type=\"shortcode.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-shortcode\"><script src=\"https:\/\/gist.github.com\/Thibault-venet\/8d9c974464561a530f472d4e159ed27d.js\"><\/script><\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-525a48d elementor-widget elementor-widget-text-editor\" data-id=\"525a48d\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><strong><a href=\"https:\/\/datascientest.com\/en\/github-course-mastering-the-platform-made-easy\">Git code<\/a> example :<\/strong><\/p><p>The code can be broken down into 4 steps:<\/p><ol><li>Data import and scaling using the StandardScaler class.<\/li><li>Variable selection using the SelectKBest class.<\/li><li>Training of 3 different models and search for the best parameters using the GridSearchCV class.<\/li><li>Compare and select the optimal model.<\/li><\/ol><p>\u00a0<\/p><p>A final step consists of instantiating all these steps in a single line of code with the <a href=\"https:\/\/datascientest.com\/en\/all-about-data-pipeline\">best model using the Pipeline class<\/a>, and predicting and evaluating on the test set.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-4099332 e-flex e-con-boxed e-con\" data-id=\"4099332\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t<div class=\"elementor-element elementor-element-7eae72c e-con-full e-flex e-con\" data-id=\"7eae72c\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;full&quot;}\">\n\t\t\t\t<div class=\"elementor-element elementor-element-5fad987 elementor-widget elementor-widget-shortcode\" data-id=\"5fad987\" data-element_type=\"widget\" data-widget_type=\"shortcode.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-shortcode\"><script src=\"https:\/\/gist.github.com\/Thibault-venet\/c0cce5f66cde7b43e025349f5e13bd4b.js\"><\/script><\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-0af43e1 e-flex e-con-boxed e-con\" data-id=\"0af43e1\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t<div class=\"elementor-element elementor-element-739ae4d e-con-full e-flex e-con\" data-id=\"739ae4d\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;full&quot;}\">\n\t\t\t\t<div class=\"elementor-element elementor-element-3cc99be elementor-widget elementor-widget-text-editor\" data-id=\"3cc99be\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>The <strong>Scikit Learn library today provides a very large number of algorithms<\/strong> with fields of application in many sectors such as industry, insurance, understanding customer data&#8230; At Datascientest we will teach you to use, understand, interpret and evaluate a large number of algorithms from the library on concrete problems. Find out more about our training courses.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5acef89 elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"5acef89\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/en\/data-courses\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Discover our courses in Data Science<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>If you study data and want to derive information from it, you will often need to process the data, modify it and, above all, build models capable of learning patterns in your data for a chosen problem. There are a number of open source libraries available to do this, but the best-known of these is [&hellip;]<\/p>\n","protected":false},"author":67,"featured_media":171499,"comment_status":"open","ping_status":"open","sticky":false,"template":"elementor_theme","format":"standard","meta":{"content-type":"","inline_featured_image":false},"categories":[2425],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v21.7 (Yoast SEO v21.7) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Scikit Learn: Discover the Python library dedicated to Machine Learning<\/title>\n<meta name=\"description\" content=\"Scikit Learn is a Python Library for Machine Learning. However, only a few Machine Learning professionals know that...\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Scikit Learn: Discover the Python library dedicated to Machine Learning\" \/>\n<meta property=\"og:description\" content=\"If you study data and want to derive information from it, you will often need to process the data, modify it and, above all, build models capable of\" \/>\n<meta property=\"og:url\" content=\"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning\" \/>\n<meta property=\"og:site_name\" content=\"Data Science Courses | DataScientest\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/DataScientestEN\" \/>\n<meta property=\"article:published_time\" content=\"2023-09-29T08:27:38+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-10-30T19:24:01+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/datascientest.com\/en\/files\/2023\/09\/illu_scikit_blog_2-08.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"562\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Melanie\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@DataScientest__\" \/>\n<meta name=\"twitter:site\" content=\"@DataScientest__\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Melanie\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning#article\",\"isPartOf\":{\"@id\":\"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning\"},\"author\":{\"name\":\"Melanie\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d\"},\"headline\":\"Scikit Learn: Discover the Python library dedicated to Machine Learning\",\"datePublished\":\"2023-09-29T08:27:38+00:00\",\"dateModified\":\"2023-10-30T19:24:01+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning\"},\"wordCount\":1379,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/datascientest.com\/en\/#organization\"},\"articleSection\":[\"Data Science\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning#respond\"]}],\"copyrightYear\":\"2023\",\"copyrightHolder\":{\"@id\":\"https:\/\/datascientest.com\/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning\",\"url\":\"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning\",\"name\":\"Scikit Learn: Discover the Python library dedicated to Machine Learning\",\"isPartOf\":{\"@id\":\"https:\/\/datascientest.com\/en\/#website\"},\"datePublished\":\"2023-09-29T08:27:38+00:00\",\"dateModified\":\"2023-10-30T19:24:01+00:00\",\"description\":\"Scikit Learn is a Python Library for Machine Learning. However, only a few Machine Learning professionals know that...\",\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/datascientest.com\/en\/#website\",\"url\":\"https:\/\/datascientest.com\/en\/\",\"name\":\"Data Science Courses | DataScientest\",\"description\":\"Leader in Data Science Courses\",\"publisher\":{\"@id\":\"https:\/\/datascientest.com\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/datascientest.com\/en\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/datascientest.com\/en\/#organization\",\"name\":\"DataScientest\",\"url\":\"https:\/\/datascientest.com\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png\",\"contentUrl\":\"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png\",\"width\":301,\"height\":301,\"caption\":\"DataScientest\"},\"image\":{\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/DataScientestEN\",\"https:\/\/twitter.com\/DataScientest__\",\"https:\/\/www.linkedin.com\/school\/datascientest\/mycompany\/\",\"https:\/\/www.tiktok.com\/@datascientest\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d\",\"name\":\"Melanie\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g\",\"caption\":\"Melanie\"},\"url\":\"https:\/\/datascientest.com\/en\/author\/melaniekrause\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Scikit Learn: Discover the Python library dedicated to Machine Learning","description":"Scikit Learn is a Python Library for Machine Learning. However, only a few Machine Learning professionals know that...","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning","og_locale":"en_GB","og_type":"article","og_title":"Scikit Learn: Discover the Python library dedicated to Machine Learning","og_description":"If you study data and want to derive information from it, you will often need to process the data, modify it and, above all, build models capable of","og_url":"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning","og_site_name":"Data Science Courses | DataScientest","article_publisher":"https:\/\/www.facebook.com\/DataScientestEN","article_published_time":"2023-09-29T08:27:38+00:00","article_modified_time":"2023-10-30T19:24:01+00:00","og_image":[{"width":1024,"height":562,"url":"https:\/\/datascientest.com\/en\/files\/2023\/09\/illu_scikit_blog_2-08.png","type":"image\/png"}],"author":"Melanie","twitter_card":"summary_large_image","twitter_creator":"@DataScientest__","twitter_site":"@DataScientest__","twitter_misc":{"Written by":"Melanie","Estimated reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning#article","isPartOf":{"@id":"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning"},"author":{"name":"Melanie","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d"},"headline":"Scikit Learn: Discover the Python library dedicated to Machine Learning","datePublished":"2023-09-29T08:27:38+00:00","dateModified":"2023-10-30T19:24:01+00:00","mainEntityOfPage":{"@id":"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning"},"wordCount":1379,"commentCount":0,"publisher":{"@id":"https:\/\/datascientest.com\/en\/#organization"},"articleSection":["Data Science"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning#respond"]}],"copyrightYear":"2023","copyrightHolder":{"@id":"https:\/\/datascientest.com\/#organization"}},{"@type":"WebPage","@id":"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning","url":"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning","name":"Scikit Learn: Discover the Python library dedicated to Machine Learning","isPartOf":{"@id":"https:\/\/datascientest.com\/en\/#website"},"datePublished":"2023-09-29T08:27:38+00:00","dateModified":"2023-10-30T19:24:01+00:00","description":"Scikit Learn is a Python Library for Machine Learning. However, only a few Machine Learning professionals know that...","inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning"]}]},{"@type":"WebSite","@id":"https:\/\/datascientest.com\/en\/#website","url":"https:\/\/datascientest.com\/en\/","name":"Data Science Courses | DataScientest","description":"Leader in Data Science Courses","publisher":{"@id":"https:\/\/datascientest.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/datascientest.com\/en\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/datascientest.com\/en\/#organization","name":"DataScientest","url":"https:\/\/datascientest.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png","contentUrl":"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png","width":301,"height":301,"caption":"DataScientest"},"image":{"@id":"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/DataScientestEN","https:\/\/twitter.com\/DataScientest__","https:\/\/www.linkedin.com\/school\/datascientest\/mycompany\/","https:\/\/www.tiktok.com\/@datascientest"]},{"@type":"Person","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d","name":"Melanie","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g","caption":"Melanie"},"url":"https:\/\/datascientest.com\/en\/author\/melaniekrause"}]}},"_links":{"self":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts\/171490"}],"collection":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/users\/67"}],"replies":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/comments?post=171490"}],"version-history":[{"count":0,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts\/171490\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/media\/171499"}],"wp:attachment":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/media?parent=171490"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/categories?post=171490"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/tags?post=171490"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}