{"id":171596,"date":"2023-09-29T16:22:51","date_gmt":"2023-09-29T15:22:51","guid":{"rendered":"https:\/\/datascientest.com\/en\/?p=171596"},"modified":"2023-09-29T16:38:26","modified_gmt":"2023-09-29T15:38:26","slug":"knn-what-is-the-knn-algorithm","status":"publish","type":"post","link":"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm","title":{"rendered":"KNN: What is the KNN Algorithm ?"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"171596\" class=\"elementor elementor-171596\" data-elementor-post-type=\"post\">\n\t\t\t\t\t\t\t<div class=\"elementor-element elementor-element-16179136 e-flex e-con-boxed e-con\" data-id=\"16179136\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-2f396b00 elementor-widget elementor-widget-heading\" data-id=\"2f396b00\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-heading-title{padding:0;margin:0;line-height:1}.elementor-widget-heading .elementor-heading-title[class*=elementor-size-]>a{color:inherit;font-size:inherit;line-height:inherit}.elementor-widget-heading .elementor-heading-title.elementor-size-small{font-size:15px}.elementor-widget-heading .elementor-heading-title.elementor-size-medium{font-size:19px}.elementor-widget-heading .elementor-heading-title.elementor-size-large{font-size:29px}.elementor-widget-heading .elementor-heading-title.elementor-size-xl{font-size:39px}.elementor-widget-heading .elementor-heading-title.elementor-size-xxl{font-size:59px}<\/style><h2 class=\"elementor-heading-title elementor-size-default\">The K-Nearest Neighbors (KNN) algorithm is a machine learning algorithm belonging to the class of simple and easy-to-implement supervised learning algorithms. It can be used to solve classification and regression problems. In this article, we will delve into the definition of this algorithm, how it works, and provide a practical programming application.<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-4b74e4d5 e-flex e-con-boxed e-con\" data-id=\"4b74e4d5\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-3877c6e8 elementor-widget elementor-widget-heading\" data-id=\"3877c6e8\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">KNN : Definition<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-602da5e0 elementor-widget elementor-widget-text-editor\" data-id=\"602da5e0\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-widget-text-editor.elementor-drop-cap-view-stacked .elementor-drop-cap{background-color:#69727d;color:#fff}.elementor-widget-text-editor.elementor-drop-cap-view-framed .elementor-drop-cap{color:#69727d;border:3px solid;background-color:transparent}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap{margin-top:8px}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap-letter{width:1em;height:1em}.elementor-widget-text-editor .elementor-drop-cap{float:left;text-align:center;line-height:1;font-size:50px}.elementor-widget-text-editor .elementor-drop-cap-letter{display:inline-block}<\/style>\t\t\t\t<p>Before delving into the <strong>KNN algorithm,<\/strong> it&#8217;s essential to revisit the basics. What is a supervised learning algorithm?<\/p><p>In supervised learning, an <a href=\"https:\/\/datascientest.com\/en\/algorithm-what-is-it\">algorithm<\/a> receives a<a href=\"https:\/\/datascientest.com\/en\/what-is-a-dataset-how-do-i-work-with-it\"> dataset that is labeled with corresponding output values<\/a>, on which it can train and establish a predictive model. This algorithm can then be used on new data to predict their corresponding output values.<\/p><p>Here&#8217;s a simplified illustration:<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-71753df2 elementor-widget elementor-widget-image\" data-id=\"71753df2\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-widget-image{text-align:center}.elementor-widget-image a{display:inline-block}.elementor-widget-image a img[src$=\".svg\"]{width:48px}.elementor-widget-image img{vertical-align:middle;display:inline-block}<\/style>\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"2291\" height=\"1564\" src=\"https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-1-KNN-1.jpg\" class=\"attachment-full size-full wp-image-171600\" alt=\"\" srcset=\"https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-1-KNN-1.jpg 2291w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-1-KNN-1-300x205.jpg 300w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-1-KNN-1-1024x699.jpg 1024w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-1-KNN-1-768x524.jpg 768w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-1-KNN-1-1536x1049.jpg 1536w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-1-KNN-1-2048x1398.jpg 2048w\" sizes=\"(max-width: 2291px) 100vw, 2291px\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\"><\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-383d09e2 elementor-widget elementor-widget-text-editor\" data-id=\"383d09e2\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>The intuition behind the K-Nearest Neighbors algorithm is one of the simplest among all supervised machine learning algorithms:<\/p><p>Step 1: Select the number K of neighbors.<br \/>Step 2: Calculate the distance&#8230;<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-171bdb56 e-flex e-con-boxed e-con\" data-id=\"171bdb56\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t<div class=\"elementor-element elementor-element-3201dc42 e-con-full e-flex e-con\" data-id=\"3201dc42\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;full&quot;}\">\n\t\t\t\t<div class=\"elementor-element elementor-element-45c5a3a8 elementor-widget elementor-widget-image\" data-id=\"45c5a3a8\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"363\" height=\"179\" src=\"https:\/\/datascientest.com\/en\/files\/2023\/09\/eucledienne.png\" class=\"attachment-large size-large wp-image-171601\" alt=\"\" srcset=\"https:\/\/datascientest.com\/en\/files\/2023\/09\/eucledienne.png 363w, https:\/\/datascientest.com\/en\/files\/2023\/09\/eucledienne-300x148.png 300w\" sizes=\"(max-width: 363px) 100vw, 363px\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\">Manhattan<\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-5e0e4227 e-con-full e-flex e-con\" data-id=\"5e0e4227\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;full&quot;}\">\n\t\t\t\t<div class=\"elementor-element elementor-element-6f2c8df elementor-widget elementor-widget-image\" data-id=\"6f2c8df\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"471\" height=\"179\" src=\"https:\/\/datascientest.com\/en\/files\/2023\/09\/m.png\" class=\"attachment-large size-large wp-image-171602\" alt=\"\" srcset=\"https:\/\/datascientest.com\/en\/files\/2023\/09\/m.png 471w, https:\/\/datascientest.com\/en\/files\/2023\/09\/m-300x114.png 300w\" sizes=\"(max-width: 471px) 100vw, 471px\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\">Euclidienne  <\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-202403cb e-flex e-con-boxed e-con\" data-id=\"202403cb\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-1ecc52c8 elementor-widget elementor-widget-text-editor\" data-id=\"1ecc52c8\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Step 3: Take the\u00a0 KNN &#8211; K nearest neighbors based on the calculated distance.<br \/>Step 4: Among these K neighbors, count the number of points belonging to each category.<br \/>Step 5: Assign the new point to the category most prevalent among these K neighbors.<br \/>Step 6: Our model is ready&#8230;<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-651f6b00 elementor-widget elementor-widget-image\" data-id=\"651f6b00\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"2385\" height=\"1145\" src=\"https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-2-KNN.jpg\" class=\"attachment-full size-full wp-image-171603\" alt=\"\" srcset=\"https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-2-KNN.jpg 2385w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-2-KNN-300x144.jpg 300w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-2-KNN-1024x492.jpg 1024w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-2-KNN-768x369.jpg 768w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-2-KNN-1536x737.jpg 1536w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-2-KNN-2048x983.jpg 2048w\" sizes=\"(max-width: 2385px) 100vw, 2385px\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\"><\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-9f44785 elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"9f44785\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/en\/data-courses\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Learn the KNN Algorithm<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-412ce8b7 e-flex e-con-boxed e-con\" data-id=\"412ce8b7\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-64980716 elementor-widget elementor-widget-heading\" data-id=\"64980716\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">KNN : Use Case<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-cf60e76 elementor-widget elementor-widget-text-editor\" data-id=\"cf60e76\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>We can now explore an example of using the K-Nearest Neighbors algorithm. <a href=\"https:\/\/datascientest.com\/en\/scikit-learn-discover-the-python-library-dedicated-to-machine-learning\">Thanks to the Scikit-Learn library,<\/a> we can import the `KNeighborsClassifier` function, which we will use on the IRIS dataset.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-15c74a64 elementor-widget elementor-widget-image\" data-id=\"15c74a64\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"2530\" height=\"772\" src=\"https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-3-KNN.jpg\" class=\"attachment-full size-full wp-image-171604\" alt=\"\" srcset=\"https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-3-KNN.jpg 2530w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-3-KNN-300x92.jpg 300w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-3-KNN-1024x312.jpg 1024w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-3-KNN-768x234.jpg 768w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-3-KNN-1536x469.jpg 1536w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-3-KNN-2048x625.jpg 2048w\" sizes=\"(max-width: 2530px) 100vw, 2530px\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\"><\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-40e0d36 elementor-widget elementor-widget-text-editor\" data-id=\"40e0d36\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>With the KNN algorithm, we achieve an excellent classification rate for plants, approaching 100%. We can also explore a method for choosing the best K for optimal classification. One approach is to create a graph of the K value and the corresponding error rate for the dataset&#8230;<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3f7ad2b6 elementor-widget elementor-widget-image\" data-id=\"3f7ad2b6\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"2319\" height=\"1293\" src=\"https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-4-KNN.jpg\" class=\"attachment-full size-full wp-image-171605\" alt=\"\" srcset=\"https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-4-KNN.jpg 2319w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-4-KNN-300x167.jpg 300w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-4-KNN-1024x571.jpg 1024w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-4-KNN-768x428.jpg 768w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-4-KNN-1536x856.jpg 1536w, https:\/\/datascientest.com\/en\/files\/2023\/09\/Illu-4-KNN-2048x1142.jpg 2048w\" sizes=\"(max-width: 2319px) 100vw, 2319px\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\"><\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3dbe923c elementor-widget elementor-widget-text-editor\" data-id=\"3dbe923c\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Therefore, we can see that the best prediction rate is achieved for a K value between 5 and 18. Beyond this range, we may observe a phenomenon called &#8220;<a href=\"https:\/\/datascientest.com\/en\/overfitting-what-is-it-how-can-i-avoid-it\">Overfitting&#8221; or &#8220;Surapprentissage&#8221; in French<\/a>. This occurs when the training data used to build a model fits the data too well but fails to make useful predictions for new data.<\/p><p>Some applications of KNN:<\/p><ol><li><strong>Optical Character Recognition (OCR):<\/strong> KNN can be used in technologies that attempt to recognize handwritten text, images, and even videos.<\/li><li><strong>Credit Scoring:<\/strong> KNN matches an individual&#8217;s characteristics with existing groups of people to assign a credit score. The individual will receive the same score as those who share similar characteristics.<\/li><li><strong>Loan Approval:<\/strong> KNN is used to predict whether a bank should grant a loan to an individual. It assesses whether the given individual matches the criteria of those who have previously defaulted on loans or not.<\/li><\/ol>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-66ac5dc9 elementor-widget elementor-widget-text-editor\" data-id=\"66ac5dc9\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Advantages:<\/p><p>1. The algorithm is simple and easy to implement.<br \/>2. There is no need to create a model, tune multiple parameters, or make additional assumptions.<br \/>3. The algorithm is versatile and can be used for both classification and regression tasks.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3808ef2 elementor-widget elementor-widget-text-editor\" data-id=\"3808ef2\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Disadvantages:<\/p><p>1. The algorithm becomes significantly slower as the number of observations and independent variables increases.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-492fa889 elementor-widget elementor-widget-text-editor\" data-id=\"492fa889\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Being<a href=\"https:\/\/datascientest.com\/en\/k-means-clustering-in-machine-learning-a-deep-dive\"> one of the simplest Machine Learning algorithms,<\/a> it is highly implemented to develop intuitive and intelligent learning-based systems that can perform and make small decisions on their own.<\/p><p>This makes things even more practical for learning and development and helps almost all types of industries that could use smart systems, solutions, or services.<\/p><p>There are many other supervised or unsupervised clustering algorithms that may be more or less appropriate depending on the situation, such as K-means, <a href=\"https:\/\/datascientest.com\/en\/exploring-the-agglomerative-hierarchical-custering-algorithm-ahc\">hierarchical agglomerative clustering (CAH),<\/a> DBSCAN (density-based spatial clustering of applications with noise), which you can find on our blog.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3128ac19 elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"3128ac19\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/en\/data-courses\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Discover our Data Courses<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>The K-Nearest Neighbors (KNN) algorithm is a machine learning algorithm belonging to the class of simple and easy-to-implement supervised learning algorithms. It can be used to solve classification and regression problems. In this article, we will delve into the definition of this algorithm, how it works, and provide a practical programming application. KNN : Definition [&hellip;]<\/p>\n","protected":false},"author":67,"featured_media":171598,"comment_status":"open","ping_status":"open","sticky":false,"template":"elementor_theme","format":"standard","meta":{"content-type":"","inline_featured_image":false},"categories":[2425],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v21.7 (Yoast SEO v21.7) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>KNN: What is the KNN Algorithm ?<\/title>\n<meta name=\"description\" content=\"Discover the essence of K-Nearest Neighbors (KNN) algorithm \u2013 a powerful machine learning technique. Learn how KNN works..\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"KNN: What is the KNN Algorithm ?\" \/>\n<meta property=\"og:description\" content=\"The K-Nearest Neighbors (KNN) algorithm is a machine learning algorithm belonging to the class of simple and easy-to-implement supervised learning\" \/>\n<meta property=\"og:url\" content=\"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm\" \/>\n<meta property=\"og:site_name\" content=\"Data Science Courses | DataScientest\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/DataScientestEN\" \/>\n<meta property=\"article:published_time\" content=\"2023-09-29T15:22:51+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-09-29T15:38:26+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/datascientest.com\/en\/files\/2023\/09\/knn.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1536\" \/>\n\t<meta property=\"og:image:height\" content=\"843\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Melanie\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@DataScientest__\" \/>\n<meta name=\"twitter:site\" content=\"@DataScientest__\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Melanie\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm#article\",\"isPartOf\":{\"@id\":\"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm\"},\"author\":{\"name\":\"Melanie\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d\"},\"headline\":\"KNN: What is the KNN Algorithm ?\",\"datePublished\":\"2023-09-29T15:22:51+00:00\",\"dateModified\":\"2023-09-29T15:38:26+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm\"},\"wordCount\":583,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/datascientest.com\/en\/#organization\"},\"articleSection\":[\"Data Science\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm#respond\"]}],\"copyrightYear\":\"2023\",\"copyrightHolder\":{\"@id\":\"https:\/\/datascientest.com\/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm\",\"url\":\"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm\",\"name\":\"KNN: What is the KNN Algorithm ?\",\"isPartOf\":{\"@id\":\"https:\/\/datascientest.com\/en\/#website\"},\"datePublished\":\"2023-09-29T15:22:51+00:00\",\"dateModified\":\"2023-09-29T15:38:26+00:00\",\"description\":\"Discover the essence of K-Nearest Neighbors (KNN) algorithm \u2013 a powerful machine learning technique. Learn how KNN works..\",\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/datascientest.com\/en\/#website\",\"url\":\"https:\/\/datascientest.com\/en\/\",\"name\":\"Data Science Courses | DataScientest\",\"description\":\"Leader in Data Science Courses\",\"publisher\":{\"@id\":\"https:\/\/datascientest.com\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/datascientest.com\/en\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/datascientest.com\/en\/#organization\",\"name\":\"DataScientest\",\"url\":\"https:\/\/datascientest.com\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png\",\"contentUrl\":\"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png\",\"width\":301,\"height\":301,\"caption\":\"DataScientest\"},\"image\":{\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/DataScientestEN\",\"https:\/\/twitter.com\/DataScientest__\",\"https:\/\/www.linkedin.com\/school\/datascientest\/mycompany\/\",\"https:\/\/www.tiktok.com\/@datascientest\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d\",\"name\":\"Melanie\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g\",\"caption\":\"Melanie\"},\"url\":\"https:\/\/datascientest.com\/en\/author\/melaniekrause\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"KNN: What is the KNN Algorithm ?","description":"Discover the essence of K-Nearest Neighbors (KNN) algorithm \u2013 a powerful machine learning technique. Learn how KNN works..","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm","og_locale":"en_GB","og_type":"article","og_title":"KNN: What is the KNN Algorithm ?","og_description":"The K-Nearest Neighbors (KNN) algorithm is a machine learning algorithm belonging to the class of simple and easy-to-implement supervised learning","og_url":"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm","og_site_name":"Data Science Courses | DataScientest","article_publisher":"https:\/\/www.facebook.com\/DataScientestEN","article_published_time":"2023-09-29T15:22:51+00:00","article_modified_time":"2023-09-29T15:38:26+00:00","og_image":[{"width":1536,"height":843,"url":"https:\/\/datascientest.com\/en\/files\/2023\/09\/knn.png","type":"image\/png"}],"author":"Melanie","twitter_card":"summary_large_image","twitter_creator":"@DataScientest__","twitter_site":"@DataScientest__","twitter_misc":{"Written by":"Melanie","Estimated reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm#article","isPartOf":{"@id":"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm"},"author":{"name":"Melanie","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d"},"headline":"KNN: What is the KNN Algorithm ?","datePublished":"2023-09-29T15:22:51+00:00","dateModified":"2023-09-29T15:38:26+00:00","mainEntityOfPage":{"@id":"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm"},"wordCount":583,"commentCount":0,"publisher":{"@id":"https:\/\/datascientest.com\/en\/#organization"},"articleSection":["Data Science"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm#respond"]}],"copyrightYear":"2023","copyrightHolder":{"@id":"https:\/\/datascientest.com\/#organization"}},{"@type":"WebPage","@id":"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm","url":"https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm","name":"KNN: What is the KNN Algorithm ?","isPartOf":{"@id":"https:\/\/datascientest.com\/en\/#website"},"datePublished":"2023-09-29T15:22:51+00:00","dateModified":"2023-09-29T15:38:26+00:00","description":"Discover the essence of K-Nearest Neighbors (KNN) algorithm \u2013 a powerful machine learning technique. Learn how KNN works..","inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/datascientest.com\/en\/knn-what-is-the-knn-algorithm"]}]},{"@type":"WebSite","@id":"https:\/\/datascientest.com\/en\/#website","url":"https:\/\/datascientest.com\/en\/","name":"Data Science Courses | DataScientest","description":"Leader in Data Science Courses","publisher":{"@id":"https:\/\/datascientest.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/datascientest.com\/en\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/datascientest.com\/en\/#organization","name":"DataScientest","url":"https:\/\/datascientest.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png","contentUrl":"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png","width":301,"height":301,"caption":"DataScientest"},"image":{"@id":"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/DataScientestEN","https:\/\/twitter.com\/DataScientest__","https:\/\/www.linkedin.com\/school\/datascientest\/mycompany\/","https:\/\/www.tiktok.com\/@datascientest"]},{"@type":"Person","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d","name":"Melanie","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g","caption":"Melanie"},"url":"https:\/\/datascientest.com\/en\/author\/melaniekrause"}]}},"_links":{"self":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts\/171596"}],"collection":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/users\/67"}],"replies":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/comments?post=171596"}],"version-history":[{"count":0,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts\/171596\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/media\/171598"}],"wp:attachment":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/media?parent=171596"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/categories?post=171596"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/tags?post=171596"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}