Listing 1 - 10 of 20 | << page >> |
Sort by
|
Choose an application
In this master's thesis, reinforcement learning (RL) methods are used to learn (near-)optimal policies to act in several Markov decision processes (MDPs) and partially observable Markov decision processes (POMDPs). More precisely, Q-learning and recurrent Q-learning techniques are used. Some of the considered POMDPs require a high-memorisation ability in order to achieve optimal decision making. In POMDPs, RL techniques usually rely on approximating functions that take as input sequences of observations with variable length. Recurrent neural networks (RNNs) are thus a clever choice of such approximators. This work is based on the recently introduced bistable recurrent cells, which have been empirically shown to provide a significantly better long term memory than standard cells, such as the long short-term memory (LSTM) and the gated recurrent unit (GRU). These cells are named the bistable recurrent cell (BRC) and the recurrently neuromodulated BRC (nBRC). First, by importing these cells for the first time in the RL setting, it is empirically shown that they also provide a significant advantage in memory-demanding POMDPs, in comparison to LSTM and GRU. Second, the ability of the RNN to represent a belief distribution over the states of the POMDP is studied. It is achieved by evaluating the mutual information between the hidden states of the RNN and the belief filtered on the successive observations. This analysis is thus strongly anchored in the theory of information and the theory of optimal control for POMDPs. Third, as a complement to this research project, a new target update is proposed for Q-learning algorithms with target networks, for both reactive and recurrent policies. This new update speeds up learning, especially in environments with sparse rewards.
Reinforcement Learning --- Belief Filtering --- POMDP --- Deep Recurrent Q-Network --- DRQN --- Online Fitted Q-Iteration --- OFQI --- RNN --- Bistable Recurrent Cell --- BRC --- Q-Learning --- Markov Decision Process --- MDP --- Bistability --- Target Network --- Partially Observable Markov Decision Process --- Recurrent Neural Network --- Mutual Information --- RL --- Ingénierie, informatique & technologie > Sciences informatiques
Choose an application
The emerging massive density of human-held and machine-type nodes implies larger traffic deviatiolns in the future than we are facing today. In the future, the network will be characterized by a high degree of flexibility, allowing it to adapt smoothly, autonomously, and efficiently to the quickly changing traffic demands both in time and space. This flexibility cannot be achieved when the network’s infrastructure remains static. To this end, the topic of UAVs (unmanned aerial vehicles) have enabled wireless communications, and networking has received increased attention. As mentioned above, the network must serve a massive density of nodes that can be either human-held (user devices) or machine-type nodes (sensors). If we wish to properly serve these nodes and optimize their data, a proper wireless connection is fundamental. This can be achieved by using UAV-enabled communication and networks. This Special Issue addresses the many existing issues that still exist to allow UAV-enabled wireless communications and networking to be properly rolled out.
Technology: general issues --- History of engineering & technology --- unmanned aerial vehicle --- UAV positioning --- machine learning --- wireless communications --- drones --- network --- DTN --- mobility schedule --- routing algorithms --- data delivery --- Internet of drones --- communication --- security --- privacy --- UAV base station --- MIMO --- millimeter-wave band --- blind beamforming --- signal recovery --- UAV relay networks --- resource management --- transmit time allocation --- unmanned aerial vehicles --- dynamic spectrum access --- quality of service --- reinforcement learning --- multi-armed bandit --- aerial communication --- FANET --- not-spots --- stratospheric communication platform --- UAV --- UAV-assisted network --- 5G --- global positioning system --- GPS spoofing attacks --- detection techniques --- dynamic selection --- hyperparameter tuning --- IoT --- RF radio communication --- Wi-Fi direct --- D2D --- drone-based mobile secure zone --- friendly jamming --- mobility --- internet of things --- non-orthogonal multiple access --- resource allocation --- ultra reliable low latency communication --- uplink transmission --- Deep Q-learning (DQL) --- Double Deep Q-learning (DDQL) --- dynamic spectrum sharing --- High Altitude Platform Station (HAPS) --- cellular communications --- power control --- interference management --- cognitive UAV networks --- clustered two-stage-fusion cooperative spectrum sensing --- continuous hidden Markov model --- SNR estimation --- n/a
Choose an application
The emerging massive density of human-held and machine-type nodes implies larger traffic deviatiolns in the future than we are facing today. In the future, the network will be characterized by a high degree of flexibility, allowing it to adapt smoothly, autonomously, and efficiently to the quickly changing traffic demands both in time and space. This flexibility cannot be achieved when the network’s infrastructure remains static. To this end, the topic of UAVs (unmanned aerial vehicles) have enabled wireless communications, and networking has received increased attention. As mentioned above, the network must serve a massive density of nodes that can be either human-held (user devices) or machine-type nodes (sensors). If we wish to properly serve these nodes and optimize their data, a proper wireless connection is fundamental. This can be achieved by using UAV-enabled communication and networks. This Special Issue addresses the many existing issues that still exist to allow UAV-enabled wireless communications and networking to be properly rolled out.
unmanned aerial vehicle --- UAV positioning --- machine learning --- wireless communications --- drones --- network --- DTN --- mobility schedule --- routing algorithms --- data delivery --- Internet of drones --- communication --- security --- privacy --- UAV base station --- MIMO --- millimeter-wave band --- blind beamforming --- signal recovery --- UAV relay networks --- resource management --- transmit time allocation --- unmanned aerial vehicles --- dynamic spectrum access --- quality of service --- reinforcement learning --- multi-armed bandit --- aerial communication --- FANET --- not-spots --- stratospheric communication platform --- UAV --- UAV-assisted network --- 5G --- global positioning system --- GPS spoofing attacks --- detection techniques --- dynamic selection --- hyperparameter tuning --- IoT --- RF radio communication --- Wi-Fi direct --- D2D --- drone-based mobile secure zone --- friendly jamming --- mobility --- internet of things --- non-orthogonal multiple access --- resource allocation --- ultra reliable low latency communication --- uplink transmission --- Deep Q-learning (DQL) --- Double Deep Q-learning (DDQL) --- dynamic spectrum sharing --- High Altitude Platform Station (HAPS) --- cellular communications --- power control --- interference management --- cognitive UAV networks --- clustered two-stage-fusion cooperative spectrum sensing --- continuous hidden Markov model --- SNR estimation --- n/a
Choose an application
The emerging massive density of human-held and machine-type nodes implies larger traffic deviatiolns in the future than we are facing today. In the future, the network will be characterized by a high degree of flexibility, allowing it to adapt smoothly, autonomously, and efficiently to the quickly changing traffic demands both in time and space. This flexibility cannot be achieved when the network’s infrastructure remains static. To this end, the topic of UAVs (unmanned aerial vehicles) have enabled wireless communications, and networking has received increased attention. As mentioned above, the network must serve a massive density of nodes that can be either human-held (user devices) or machine-type nodes (sensors). If we wish to properly serve these nodes and optimize their data, a proper wireless connection is fundamental. This can be achieved by using UAV-enabled communication and networks. This Special Issue addresses the many existing issues that still exist to allow UAV-enabled wireless communications and networking to be properly rolled out.
Technology: general issues --- History of engineering & technology --- unmanned aerial vehicle --- UAV positioning --- machine learning --- wireless communications --- drones --- network --- DTN --- mobility schedule --- routing algorithms --- data delivery --- Internet of drones --- communication --- security --- privacy --- UAV base station --- MIMO --- millimeter-wave band --- blind beamforming --- signal recovery --- UAV relay networks --- resource management --- transmit time allocation --- unmanned aerial vehicles --- dynamic spectrum access --- quality of service --- reinforcement learning --- multi-armed bandit --- aerial communication --- FANET --- not-spots --- stratospheric communication platform --- UAV --- UAV-assisted network --- 5G --- global positioning system --- GPS spoofing attacks --- detection techniques --- dynamic selection --- hyperparameter tuning --- IoT --- RF radio communication --- Wi-Fi direct --- D2D --- drone-based mobile secure zone --- friendly jamming --- mobility --- internet of things --- non-orthogonal multiple access --- resource allocation --- ultra reliable low latency communication --- uplink transmission --- Deep Q-learning (DQL) --- Double Deep Q-learning (DDQL) --- dynamic spectrum sharing --- High Altitude Platform Station (HAPS) --- cellular communications --- power control --- interference management --- cognitive UAV networks --- clustered two-stage-fusion cooperative spectrum sensing --- continuous hidden Markov model --- SNR estimation
Choose an application
Artificial intelligence (AI) is regarded as the science and technology for producing an intelligent machine, particularly, an intelligent computer program. Machine learning is an approach to realizing AI comprising a collection of statistical algorithms, of which deep learning is one such example. Due to the rapid development of computer technology, AI has been actively explored for a variety of academic and practical purposes in the context of financial markets. This book focuses on the broad topic of “AI and Financial Markets”, and includes novel research associated with this topic. The book includes contributions on the application of machine learning, agent-based artificial market simulation, and other related skills to the analysis of various aspects of financial markets.
algorithmic trading --- Stop Loss --- Turtle --- ATR --- community finances --- fiscal flexibility --- individualized financial arrangements --- sustainable financial services --- price momentum --- hidden markov model --- asset allocation --- blockchain --- BlockCloud --- Artificial Intelligence --- consensus algorithms --- exchange rates --- fundamentals --- prediction --- random forest --- support vector machine --- neural network --- deep reinforcement learning --- financial market simulation --- agent based simulation --- artificial market --- simulation --- CAR regulation --- portfolio --- contract for difference --- CfD --- reinforcement learning --- RL --- neural networks --- long short-term memory --- LSTM --- Q-learning --- deep learning --- uncertainty --- economic policy --- text mining --- topic model --- yield curve --- term structure of interest rates --- machine learning --- autoencoder --- interpretability
Choose an application
Artificial intelligence (AI) is regarded as the science and technology for producing an intelligent machine, particularly, an intelligent computer program. Machine learning is an approach to realizing AI comprising a collection of statistical algorithms, of which deep learning is one such example. Due to the rapid development of computer technology, AI has been actively explored for a variety of academic and practical purposes in the context of financial markets. This book focuses on the broad topic of “AI and Financial Markets”, and includes novel research associated with this topic. The book includes contributions on the application of machine learning, agent-based artificial market simulation, and other related skills to the analysis of various aspects of financial markets.
Economics, finance, business & management --- algorithmic trading --- Stop Loss --- Turtle --- ATR --- community finances --- fiscal flexibility --- individualized financial arrangements --- sustainable financial services --- price momentum --- hidden markov model --- asset allocation --- blockchain --- BlockCloud --- Artificial Intelligence --- consensus algorithms --- exchange rates --- fundamentals --- prediction --- random forest --- support vector machine --- neural network --- deep reinforcement learning --- financial market simulation --- agent based simulation --- artificial market --- simulation --- CAR regulation --- portfolio --- contract for difference --- CfD --- reinforcement learning --- RL --- neural networks --- long short-term memory --- LSTM --- Q-learning --- deep learning --- uncertainty --- economic policy --- text mining --- topic model --- yield curve --- term structure of interest rates --- machine learning --- autoencoder --- interpretability
Choose an application
Metal manufacturing is a fundamental and indispensable technology in the processing of raw metals into desired products, which significantly promotes the development of industry and society overall. This book presents original research and a state of the art review of contemporary metal manufacturing processes, especially in the modeling, optimization, and design of the manufacturing processes. This book covers topics such as machine learning algorithms in manufacturing metal products, the fabrication and optimization of mechanical properties of metals, and numerical simulations and experiments in the machining of metals. The book presents some essential theories and successful manufacturing techniques for the low-cost and highly efficient production of metals.
Business strategy --- Manufacturing industries --- machine learning --- reinforcement learning --- Q-learning --- steelmaking process CAS-OB --- decision-support system --- optimisation algorithm --- 3D auxetic structures --- selective laser melting --- micro assembled --- structural surface layer model --- A380 alloy --- Ca --- AlFeSi phase --- refine --- micro-cutting --- grain size --- surface integrity --- cutting forces --- chip formation --- OFHC copper C102 --- amorphous alloys --- Fe-based amorphous alloys --- difficult-to-machine --- assisted machining --- high-frequency PCB --- drilling --- coating technology --- tool wear --- hot filament chemical vapor deposition --- PCBN tool --- gray cast iron --- surface quality --- temperature prediction --- weighted regularized extreme learning machine --- just-in-time learning --- sample similarities --- variable correlations --- tool edge preparation --- orthogonal cutting --- numerical simulation --- ANOVA --- temperature --- stress --- ECAP --- metallic materials --- processing parameters --- deformation mechanism --- n/a
Choose an application
Machine learning is extending its applications in various fields, such as image processing, the Internet of Things, user interface, big data, manufacturing, management, etc. As data are required to build machine learning networks, sensors are one of the most important technologies. In addition, machine learning networks can contribute to the improvement in sensor performance and the creation of new sensor applications. This Special Issue addresses all types of machine learning applications related to sensors and imaging. It covers computer vision-based control, activity recognition, fuzzy label classification, failure classification, motor temperature estimation, the camera calibration of intelligent vehicles, error detection, color prior model, compressive sensing, wildfire risk assessment, shelf auditing, forest-growing stem volume estimation, road management, image denoising, and touchscreens.
star image --- image denoising --- reinforcement learning --- maximum likelihood estimation --- mixed Poisson–Gaussian likelihood --- machine learning-based classification --- non-uniform foundation --- stochastic analysis --- vehicle–pavement–foundation interaction --- forest growing stem volume --- coniferous plantations --- variable selection --- texture feature --- random forest --- red-edge band --- on-shelf availability --- semi-supervised learning --- deep learning --- image classification --- machine learning --- explainable artificial intelligence --- wildfire --- risk assessment --- Naïve bayes --- transmission-line corridors --- image encryption --- compressive sensing --- plaintext related --- chaotic system --- convolutional neural network --- color prior model --- object detection --- piston error detection --- segmented telescope --- BP artificial neural network --- modulation transfer function --- computer vision --- intelligent vehicles --- extrinsic camera calibration --- structure from motion --- convex optimization --- temperature estimation --- BLDC --- electric machine protection --- touchscreen --- capacitive --- display --- SNR --- stylus --- laser cutting --- quality monitoring --- artificial neural network --- burr formation --- cut interruption --- fiber laser --- semi-supervised --- fuzzy --- noisy --- real-world --- plankton --- marine --- activity recognition --- wearable sensors --- imbalanced activities --- sampling methods --- path planning --- Q-learning --- neural network --- YOLO algorithm --- robot arm --- target reaching --- obstacle avoidance
Choose an application
Climate change, urban air quality, and dependency on crude oil are important societal challenges. In the transportation sector especially, clean and energy efficient technologies must be developed. Electric vehicles (EVs) and plug-in hybrid electric vehicles (PHEVs) have gained a growing interest in the vehicle industry. Nowadays, the commercialization of EVs and PHEVs has been possible in different applications (i.e., light duty, medium duty, and heavy duty vehicles) thanks to the advances in energy storage systems, power electronics converters (including DC/DC converters, DC/AC inverters, and battery charging systems), electric machines, and energy efficient power flow control strategies. This book is based on the Special Issue of the journal Applied Sciences on "Plug-In Hybrid Electric Vehicles (PHEVs)". This collection of research articles includes topics such as novel propulsion systems, emerging power electronics and their control algorithms, emerging electric machines and control techniques, energy storage systems, including BMS, and efficient energy management strategies for hybrid propulsion, vehicle-to-grid (V2G), vehicle-to-home (V2H), grid-to-vehicle (G2V) technologies, and wireless power transfer (WPT) systems.
hybrid energy storage system --- plug-in hybrid electric vehicle --- Li-ion battery --- emerging electric machines --- lithium-ion capacitor --- electric vehicles (EVs) --- efficient energy management strategies for hybrid propulsion systems --- plug-in hybrid --- attributional --- electric vehicle --- energy system --- energy efficiency --- modified one-state hysteresis model --- air quality --- adaptive neuron-fuzzy inference system (ANFIS) --- Markov decision process (MDP) --- simulated annealing --- Paris Agreement --- mobility needs --- interleaved multiport converte --- dynamic programming --- state of health estimation --- strong track filter --- LCA --- modelling --- consequential --- losses model --- voltage vector distribution --- parallel hybrid electric vehicle --- electricity mix --- time-delay input --- convex optimization --- lifetime model --- artificial neural network (ANN) --- Li(Ni1/3Co1/3Mn1/3)O2 battery --- battery power --- CO2 --- capacity degradation --- regenerative braking --- open-end winding --- novel propulsion systems --- group method of data handling (GMDH) --- state of charge --- Well-to-Wheel --- energy storage systems --- including wide bandgap (WBG) technology --- wide bandgap (WBG) technologies --- marginal --- lithium polymer battery --- life-cycle assessment (LCA) --- energy management --- dual inverter --- lithium-ion battery --- measurements --- plug-in hybrid electric vehicles (PHEVs) --- emerging power electronics --- Q-learning (QL) --- fuel consumption characteristics --- Plugin Hybrid electric vehicle --- Energy Storage systems --- meta-analysis --- range-extender --- engine-on power --- reinforcement learning (RL) --- multi-objective genetic algorithm --- power sharing --- energy management strategy --- power distribution --- hybrid electric vehicles --- system modelling
Choose an application
Intelligent optimization is based on the mechanism of computational intelligence to refine a suitable feature model, design an effective optimization algorithm, and then to obtain an optimal or satisfactory solution to a complex problem. Intelligent algorithms are key tools to ensure global optimization quality, fast optimization efficiency and robust optimization performance. Intelligent optimization algorithms have been studied by many researchers, leading to improvements in the performance of algorithms such as the evolutionary algorithm, whale optimization algorithm, differential evolution algorithm, and particle swarm optimization. Studies in this arena have also resulted in breakthroughs in solving complex problems including the green shop scheduling problem, the severe nonlinear problem in one-dimensional geodesic electromagnetic inversion, error and bug finding problem in software, the 0-1 backpack problem, traveler problem, and logistics distribution center siting problem. The editors are confident that this book can open a new avenue for further improvement and discoveries in the area of intelligent algorithms. The book is a valuable resource for researchers interested in understanding the principles and design of intelligent algorithms.
Technology: general issues --- global optimization --- cuckoo search algorithm --- Q-learning --- mutation --- self-adaptive step size --- evolutionary computation --- playtesting --- game feature --- game simulation --- game trees --- playtesting metric --- validation --- Pareto optimality --- h-index --- ranking --- dominance --- Pareto-front --- multi-indicators --- multi-metric --- multi-resources --- citation --- universities ranking --- swarm intelligence --- simulated annealing --- krill herd --- particle swarm optimization --- quantum --- elephant herding optimization --- engineering optimization --- metaheuristic --- constrained optimization --- multi-objective optimization --- single objective optimization --- differential evolution --- success-history --- premature convergence --- turning-based mutation --- opposition-based learning --- ant colony optimization --- opposite path --- traveling salesman problems --- whale optimization algorithm --- WOA --- binary whale optimization algorithm --- bWOA-S --- bWOA-V --- feature selection --- classification --- dimensionality reduction --- menu planning problem --- evolutionary algorithm --- decomposition-based multi-objective optimisation --- memetic algorithm --- iterated local search --- diversity preservation --- single-objective optimization --- knapsack problem --- travelling salesman problem --- seed schedule --- many-objective optimization --- fuzzing --- bug detection --- path discovery --- evolutionary algorithms (EAs) --- coevolution --- dynamic learning --- performance indicators --- magnetotelluric --- one-dimensional inversions --- geoelectric model --- optimization problem --- multi-task optimization --- multi-task evolutionary computation --- knowledge transfer --- assortative mating --- unified search space --- quantum computing --- grey wolf optimizer --- 0-1 knapsack problem --- green shop scheduling --- fuzzy hybrid flow shop scheduling --- discrete artificial bee colony algorithm --- minimize makespan --- minimize total energy consumption
Listing 1 - 10 of 20 | << page >> |
Sort by
|