Parrot Trade
  • Parrot Trade
  • Introduction
  • Background of the project
  • Project Overview
  • Technical Overview
  • Technical architecture overview
  • Core functions and features
  • Data collection and preprocessing
  • Data cleaning and denoising
  • Data standardization and normalization
  • Data transformation and feature engineering
  • AI intelligent learning and training model
  • Neural network model architecture
  • Supervised and unsupervised learning algorithms
  • Model evaluation and optimization strategies
  • Intelligent Trading Strategy
  • Risk Management and Money Management
  • Real-time decision-making and trade execution
  • Technical implementation and system architecture
  • Data storage and processing
  • Real-time data stream processing
  • Distributed computing and high availability
  • Security and Privacy Protection
  • Development Roadmap
  • Commercial Application and Value
  • Conclusion and Outlook
  • Appendix
Powered by GitBook
On this page

Data cleaning and denoising

During the data collection process, the Parrot platform will face some common data quality problems, such as missing data, outliers, etc., and requires data cleaning and denoising operations to ensure the quality and reliability of the data.

  1. Missing data handling: The Parrot platform detects and handles missing values in the data. For missing values, you can choose to delete missing data, use interpolation to fill missing values, or use other related data for prediction completion.

  2. Outlier detection and processing: The Parrot platform will detect outliers in the data through statistical methods or machine learning methods. For outliers, you can choose to delete, correct or smooth them to avoid adverse effects on subsequent analysis and modeling.

  3. Data deduplication: The Parrot platform will detect and process duplicate values in the data to avoid duplicate data from interfering with subsequent analysis and modeling. For duplicate values, you can choose to delete or merge them.

  4. Unified data format: The Parrot platform will unify the format and data type of data to facilitate subsequent data analysis and modeling. For data of different formats and types, format conversion and data type conversion can be performed.

  5. Abnormal data processing: The Parrot platform will process abnormal data, including but not limited to data smoothing, censoring, truncation and other methods, to eliminate the impact of abnormal data on analysis results.

PreviousData collection and preprocessingNextData standardization and normalization

Last updated 1 year ago