Loading...
Search for: outliers
0.006 seconds
Total 34 records

    Estimating aqueous nanofluids viscosity via GEP modeling: Correlation development and data assessment

    , Article Iranian Journal of Chemistry and Chemical Engineering ; Volume 41, Issue 1 , 2022 , Pages 266-283 ; 10219986 (ISSN) Mahdaviara, M ; Rostami, A ; Shahbazi, K ; Shokrollahi, A ; Ghazanfari, M. H ; Sharif University of Technology
    Iranian Institute of Research and Development in Chemical Industries  2022
    Abstract
    This paper focuses on developing a new method that represents user-accessible correlation for the estimation of water-based nanofluids viscosity. For this, an evolutionary algorithm, namely Gene Expression Programming (GEP), was adapted based on a wide selection of literature published databanks including 819 water-based nanofluids viscosity points. The developed model utilized the base fluid viscosity as well as volume fraction and size of the nanoparticles as the inputs of the model. Several statistical parameters integrated with graphical plots were employed in order to assess the accuracy of the proposed GEP-based model. Results of the evaluation demonstrate fairly enough accuracy of the... 

    Massively Parallel Clustering with Outliers

    , M.Sc. Thesis Sharif University of Technology Navidi Ghaziani, Zahra (Author) ; Zarrabizadeh, Hamid (Supervisor)
    Abstract
    Clustering is a fundamental problem for data analysis, and it has a lot of variants. In this thesis we focused on the k-center problem, which is one of the most popular and well-studied variants of clustering. In this problem we are given a metric set of points called X, and a parameter k ⩽ |X|. Our goal is to find a set of k centers in X, minimizing the maximum distance of any point of X from its closest center. This thesis has worked on a version of the problem that is harder to solve. we have an extra parameter called z, which represents the maximum number of points that there is no need to be clustered, and we refer to them as outliers. The growth of data that needs to be processed makes... 

    Rigorous modeling of gypsum solubility in Na-Ca-Mg-Fe-Al-H-Cl-H2O system at elevated temperatures

    , Article Neural Computing and Applications ; Volume 25, Issue 3 , September , 2014 , pp 955-965 ; ISSN: 09410643 Safari, H ; Gharagheizi, F ; Lemraski, A. S ; Jamialahmadi, M ; Mohammadi, A. H ; Ebrahimi, M ; Sharif University of Technology
    Abstract
    Precipitation and scaling of calcium sulfate have been known as major problems facing process industries and oilfield operations. Most scale prediction models are based on aqueous thermodynamics and solubility behavior of salts in aqueous electrolyte solutions. There is yet a huge interest in developing reliable, simple, and accurate solubility prediction models. In this study, a comprehensive model based on least-squares support vector machine (LS-SVM) is presented, which is mainly devoted to calcium sulfate dihydrate (or gypsum) solubility in aqueous solutions of mixed electrolytes covering wide temperature ranges. In this respect, an aggregate of 880 experimental data were gathered from... 

    An algorithm for discovering clusters of different densities or shapes in noisy data sets

    , Article Proceedings of the ACM Symposium on Applied Computing ; March , 2013 , Pages 144-149 ; 9781450316569 (ISBN) Khani, F ; Hosseini, M. J ; Abin, A. A ; Beigy, H ; Sharif University of Technology
    2013
    Abstract
    In clustering spatial data, we are given a set of points in Rn and the objective is to find the clusters (representing spatial objects) in the set of points. Finding clusters with different shapes, sizes, and densities in data with noise and potentially outliers is a challenging task. This problem is especially studied in machine learning community and has lots of applications. We present a novel clustering technique, which can solve mentioned issues considerably. In the proposed algorithm, we let the structure of the data set itself find the clusters, this is done by having points actively send and receive feedbacks to each other. The idea of the proposed method is to transform the input... 

    SC-RANSAC: spatial consistency on RANSAC

    , Article Multimedia Tools and Applications ; 2018 ; 13807501 (ISSN) Fotouhi, M ; Hekmatian, H ; Kashani Nezhad, M. A ; Kasaei, S ; Sharif University of Technology
    Springer New York LLC  2018
    Abstract
    The goal of robust parameter estimation is developing a model which can properly fit to data. Parameter estimation of a geometric model, in presence of noise and error, is an important step in many image processing and computer vision applications. As the random sample consensus (RANSAC) algorithm is one of the most well-known algorithms in this field, there have been several attempts to improve its performance. In this paper, after giving a short review on existing methods, a robust and efficient method that detects the gross outliers to increase the inlier to outlier ratio in a reduced set of corresponding image points is proposed. It has a new hypothesis and verification scheme which... 

    SC-RANSAC: Spatial consistency on RANSAC

    , Article Multimedia Tools and Applications ; Volume 78, Issue 7 , 2019 , Pages 9429-9461 ; 13807501 (ISSN) Fotouhi, M ; Hekmatian, H ; Kashani Nezhad, M. A ; Kasaei, S ; Sharif University of Technology
    Springer New York LLC  2019
    Abstract
    The goal of robust parameter estimation is developing a model which can properly fit to data. Parameter estimation of a geometric model, in presence of noise and error, is an important step in many image processing and computer vision applications. As the random sample consensus (RANSAC) algorithm is one of the most well-known algorithms in this field, there have been several attempts to improve its performance. In this paper, after giving a short review on existing methods, a robust and efficient method that detects the gross outliers to increase the inlier to outlier ratio in a reduced set of corresponding image points is proposed. It has a new hypothesis and verification scheme which... 

    Graph-Based Outlier Detection

    , M.Sc. Thesis Sharif University of Technology Noori Zehmakan, Abdolahad (Author) ; Daneshgar, Amir (Supervisor)
    Abstract
    One of the most heatedly debated issues in Computer Science is Outlier Detection due to its vast and substantial applications such as credit cards, Image Processing,tax fraud detection, and medical approaches. Consequently, Outlier detection has been researched within various domains and knowledge disciplines. On the other hand, the research attempts have not been sufficient to overcome this critical problem considerably inasmuch as nearly all proposed techniques are associated with a special kind of applications or datasets.Firstly, this thesis attempts to provide a precise definition which not only excludes other one’s drawbacks, but also has its distinctive merits. Three essential... 

    An intelligent modeling approach for prediction of thermal conductivity of CO2

    , Article Journal of Natural Gas Science and Engineering ; Volume 27 , November , 2015 , Pages 138-150 ; 18755100 (ISSN) Shams, R ; Esmaili, S ; Rashid, S ; Suleymani, M ; Sharif University of Technology
    Elsevier  2015
    Abstract
    In the design of a carbon dioxide capture and storage (CCS) process, the thermal conductivity of carbon dioxide is of special concern. Hence, it is quite important to search for a quick and accurate determination of thermal conductivity of CO2 for precise modeling and evaluation of such a process. To achieve this aim, a robust computing methodology, entitled least square support vector machine (LSSVM) modeling, which is coupled with an optimization approach, was used to model this transport property. The model was constructed and evaluated employing a comprehensive data bank (more than 550 data series) covering wide ranges of pressures and temperatures. Before constructing the model, outlier... 

    Robust Clustering Using Outlier-Sparsity Regularization

    , M.Sc. Thesis Sharif University of Technology Rahimi, Yaghoub (Author) ; Daneshgar, Amir (Supervisor)
    Abstract
    Although clustering algorithms such as k-means and probabilistic clustering are quite popular and widely used nowadays, their performance are too sensitive to the presence of outliers where Even few outliers can compromise the ability of these algorithms to extract hidden data substructures. In this thesis, after going through the basics of some optimization methods such as BCD, EM, and MM, in Section 2 and a review of relevant clustering methods in Section 3, we explore the results of [Forero, et al., Robust clustering using outlier-sparsity regularization. IEEE Trans. Signal Process. (60), 2012] in Sections 4 and 5 where the outliers are handled by introducing a regularization term in the... 

    Sparse based similarity measure for mono-modal image registration

    , Article Iranian Conference on Machine Vision and Image Processing, MVIP ; Sept , 2013 , Pages 462-466 ; 21666776 (ISSN) ; 9781467361842 (ISBN) Ghaffari, A ; Fatemizadeh, E ; Sharif University of Technology
    IEEE Computer Society  2013
    Abstract
    Similarity measure is an important key in image registration. Most traditional intensity-based similarity measures (e.g., SSD, CC, MI, and CR) assume stationary image and pixel by pixel independence. Hence, perfect image registration cannot be achieved especially in presence of spatially-varying intensity distortions and outlier objects that appear in one image but not in the other. Here, we suppose that non stationary intensity distortion (such as Bias field or Outlier) has sparse representation in transformation domain. Based on this as-sumption, the zero norm (ℓ0)of the residual image between two registered images in transform domain is introduced as a new similarity measure in presence... 

    Phase-I robust parameter estimation of simple linear profiles in multistage processes

    , Article Communications in Statistics: Simulation and Computation ; 2019 ; 03610918 (ISSN) Khedmati, M ; Akhavan Niaki, T ; Sharif University of Technology
    Taylor and Francis Inc  2019
    Abstract
    This paper addresses the problem of robust parameter estimation of simple linear profiles in multistage processes in the presence of outliers in Phase I. In this regard, two robust approaches, namely the Huber’s M-estimator and the MM estimator, are proposed to estimate the parameters of the process in Phase I in the presence of outliers in historical data. In addition, the U statistic is applied to the robust parameter estimates to remove the effect of the cascade property in multistage processes and as a result, to obtain adjusted robust estimates of the parameters of simple linear profiles. The performance of the proposed methods is evaluated under weak and strong autocorrelations... 

    Phase-I robust parameter estimation of simple linear profiles in multistage processes

    , Article Communications in Statistics: Simulation and Computation ; 2019 ; 03610918 (ISSN) Khedmati, M ; Akhavan Niaki, S. T ; Sharif University of Technology
    Taylor and Francis Inc  2019
    Abstract
    This paper addresses the problem of robust parameter estimation of simple linear profiles in multistage processes in the presence of outliers in Phase I. In this regard, two robust approaches, namely the Huber’s M-estimator and the MM estimator, are proposed to estimate the parameters of the process in Phase I in the presence of outliers in historical data. In addition, the U statistic is applied to the robust parameter estimates to remove the effect of the cascade property in multistage processes and as a result, to obtain adjusted robust estimates of the parameters of simple linear profiles. The performance of the proposed methods is evaluated under weak and strong autocorrelations... 

    Phase-I robust parameter estimation of simple linear profiles in multistage processes

    , Article Communications in Statistics: Simulation and Computation ; Volume 51, Issue 2 , 2022 , Pages 460-485 ; 03610918 (ISSN) Khedmati, M ; Akhavan Niaki, S. T ; Sharif University of Technology
    Taylor and Francis Ltd  2022
    Abstract
    This paper addresses the problem of robust parameter estimation of simple linear profiles in multistage processes in the presence of outliers in Phase I. In this regard, two robust approaches, namely the Huber’s M-estimator and the MM estimator, are proposed to estimate the parameters of the process in Phase I in the presence of outliers in historical data. In addition, the U statistic is applied to the robust parameter estimates to remove the effect of the cascade property in multistage processes and as a result, to obtain adjusted robust estimates of the parameters of simple linear profiles. The performance of the proposed methods is evaluated under weak and strong autocorrelations... 

    An Outlier Detection and Cleaning Algorithm in Classification Applications

    , M.Sc. Thesis Sharif University of Technology Kasaeian, Mojtaba (Author) ; Beigy, Hamid (Supervisor)
    Abstract
    Increasing information in real world needs the special instrument for data saving, cleaning and processing. Data cleaning is so important steps in machine learning application that include various kind of procedures such as, duplicate detection, fill out missing value and outlier detection. Outliers are observation, which deviates so much from other observations as to arouse suspicions that it was generated by a different mechanism. Many researches has been carried out in the machine learning field with regards to the outlier detection that has applications in real world, like: Intrusion detection for network security, fraud detection in credit cards, fault detection for security in critical... 

    Approximating k-Center with Outliers in the Sliding Window Model

    , M.Sc. Thesis Sharif University of Technology Mostafavi, Ali (Author) ; Zarrabi Zadeh, Hamid (Supervisor)
    Abstract
    With the emergence of massive datasets, storing all of the data in memory is not feasible for many problems. This fact motivated the introduction of new data processing models such as the streaming model. In this model, data points arrive one by one and the available memory is too small to store all of the data points. For many problems, more recent data points are more important than the old ones. The sliding window model captures this fact by trying to find the solution for the n most recent data points using only o(n) memory. The k-center problem is an important optimization problem in which given a graph, we are interested in labeling k vertices of the graph as centers such that the... 

    Pupil Detection and Eye Tracking

    , M.Sc. Thesis Sharif University of Technology Sobhani, Elahe (Author) ; Babaie Zadeh, Massoud (Supervisor)
    Abstract
    About a century, “Eye Tracking” has been studied, and it has two definitions: • The process of measuring the point of gaze (where one is looking). • The process of measuring the motion of an eye relative to the head. Eye tracking technology has been used in many fields such as psychology. However, applications of this technology has been recently considered in marketing, computer interfacing, entertainment, training and so forth. Since pupil is a distinc area in eye images, pupil detection is one of the effective solutions of eye tracking. In most of the pupil detection approaches, the edge points of the pupil contour are detected firstly, and then the optimal ellipse is fitted to them.... 

    Clustering and outlier detection using isoperimetric number of trees

    , Article Pattern Recognition ; Volume 46, Issue 12 , December , 2013 , Pages 3371-3382 ; 00313203 (ISSN) Daneshgar, A ; Javadi, R ; Shariat Razavi, S. B ; Sharif University of Technology
    2013
    Abstract
    We propose a graph-based data clustering algorithm which is based on exact clustering of a minimum spanning tree in terms of a minimum isoperimetry criteria. We show that our basic clustering algorithm runs in O(nlogn) and with post-processing in almost O(nlogn) (average case) and O(n2) (worst case) time where n is the size of the data-set. It is also shown that our generalized graph model, which also allows the use of potentials at vertices, can be used to extract an extra piece of information related to anomalous data patterns and outliers. In this regard, we propose an algorithm that extracts outliers in parallel to data clustering. We also provide a comparative performance analysis of... 

    Robust Huber similarity measure for image registration in the presence of spatially-varying intensity distortion

    , Article Signal Processing ; Volume 109 , April , 2015 , Pages 54-68 ; 01651684 (ISSN) Ghaffari, A ; Fatemizadeh, E ; Sharif University of Technology
    Elsevier  2015
    Abstract
    Similarity measure is an important part of image registration. The main challenge of similarity measure is lack of robustness to different distortions. A well-known distortion is spatially-varying intensity distortion. Its main characteristic is correlation among pixels. Most traditional intensity based similarity measures (e.g., SSD, MI) assume stationary image and pixel to pixel independence. Hence, these similarity measures are not robust against spatially-varying intensity distortion. Here, we suppose that non-stationary intensity distortion has a sparse representation in transform domain, i.e. its distribution has high peak at origin and a long tail. We use two viewpoints of Maximum... 

    A streaming algorithm for 2-center with outliers in high dimensions

    , Article Computational Geometry: Theory and Applications ; Volume 60 , 2017 , Pages 26-36 ; 09257721 (ISSN) Hatami, B ; Zarrabi Zadeh, H ; Sharif University of Technology
    Abstract
    We study the 2-center problem with outliers in high-dimensional data streams. Given a stream of points in arbitrary d dimensions, the goal is to find two congruent balls of minimum radius covering all but at most z points. We present a (1.8+ε)-approximation streaming algorithm, improving over the previous (4+ε)-approximation algorithm available for the problem. The space complexity and update time of our algorithm are poly(d,z,1/ε), independent of the size of the stream. © 2016 Elsevier B.V  

    Multi-Resolution Denoising of Well Test Data

    , Ph.D. Dissertation Sharif University of Technology Khadivi, Kourosh (Author) ; Soltanieh, Mohammad (Supervisor) ; Farhadpour, Farhad Ali (Co-Advisor)
    Abstract
    Permanent Downhole Gauge (PDG) has been employed since 1990s to acquire more information and better access to well and control production. PDG provides huge amount of pressure transient data during well test operation and production. However, such data are encountering with various noise and outliers. The noise and outliers can cause misleading and misinterpretation results. Therefore, denoising and outlier removal are two imperative steps before pressure transient analysis. The conventional denoising methods are mostly based on wavelet thresholding methods that preserve mean of data and have good performance when noise distribution is Gaussian distribution. However, noise distribution...