Home Technology peripherals AI How to create a simple neural network using PyTorch

How to create a simple neural network using PyTorch

Jan 25, 2024 am 09:27 AM
Artificial neural networks

How to create a simple neural network using PyTorch

PyTorch is a Python-based deep learning framework for building various neural networks. This article will show how to use PyTorch to build a simple neural network and provide code examples.

First, we need to install PyTorch. It can be installed from the command line with the following command:

pip install torch
Copy after login

Next, we will use PyTorch to build a simple fully connected neural network for binary classification tasks. This neural network will have two hidden layers with 10 neurons each. We will use the sigmoid activation function and the cross-entropy loss function.

The following is the complete code:

import torch
import torch.nn as nn
import torch.optim as optim

# 定义神经网络模型
class Net(nn.Module):
    def __init__(self):
        super(Net, self).__init__()
        self.fc1 = nn.Linear(2, 10)  # 第一个隐藏层
        self.fc2 = nn.Linear(10, 10)  # 第二个隐藏层
        self.fc3 = nn.Linear(10, 1)  # 输出层

    def forward(self, x):
        x = torch.sigmoid(self.fc1(x))
        x = torch.sigmoid(self.fc2(x))
        x = torch.sigmoid(self.fc3(x))
        return x

# 创建数据集
X = torch.tensor([[0, 0], [0, 1], [1, 0], [1, 1]], dtype=torch.float32)
y = torch.tensor([[0], [1], [1], [0]], dtype=torch.float32)

# 创建神经网络实例
net = Net()

# 定义损失函数和优化器
criterion = nn.BCELoss()
optimizer = optim.SGD(net.parameters(), lr=0.1)

# 训练神经网络
for epoch in range(10000):
    optimizer.zero_grad()
    output = net(X)
    loss = criterion(output, y)
    loss.backward()
    optimizer.step()

    # 打印训练损失
    if epoch % 1000 == 0:
    print('Epoch {}: loss = {}'.format(epoch, loss.item()))

# 使用训练好的神经网络进行预测
with torch.no_grad():
    output = net(X)
    predicted = (output > 0.5).float()
    print('Predicted: {}\n'.format(predicted))
Copy after login

First, we define a class named Net, which inherits from nn.Module. This class contains all layers of the neural network. In this example, we define three fully connected layers, the first two of which are hidden layers and the last one is the output layer.

In the Net class, in addition to defining a forward method to describe the forward propagation process of the neural network, we also use the sigmoid activation function to pass the output of each hidden layer to Next level.

Next, we created a dataset containing four samples, each with two features. We also defined a neural network instance named net and selected BCELoss as the loss function and SGD as the optimizer.

Then, we start training the neural network. In each iteration, we first zero out the gradient of the optimizer and then pass the dataset X into the neural network to get the output. We calculate the loss and perform backpropagation, and finally update the network parameters using an optimizer. We also printed the training loss for every 1000 iterations.

After training is completed, we use the no_grad context manager to make predictions on the dataset. We will output the four predictions and print them.

This is a simple example demonstrating how to build a basic neural network using PyTorch. PyTorch provides many tools and functions to help us build and train neural networks more easily.

The above is the detailed content of How to create a simple neural network using PyTorch. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

Hot Topics

Java Tutorial
1663
14
PHP Tutorial
1264
29
C# Tutorial
1237
24
A case study of using bidirectional LSTM model for text classification A case study of using bidirectional LSTM model for text classification Jan 24, 2024 am 10:36 AM

The bidirectional LSTM model is a neural network used for text classification. Below is a simple example demonstrating how to use bidirectional LSTM for text classification tasks. First, we need to import the required libraries and modules: importosimportnumpyasnpfromkeras.preprocessing.textimportTokenizerfromkeras.preprocessing.sequenceimportpad_sequencesfromkeras.modelsimportSequentialfromkeras.layersimportDense,Em

Calculating floating point operands (FLOPS) for neural networks Calculating floating point operands (FLOPS) for neural networks Jan 22, 2024 pm 07:21 PM

FLOPS is one of the standards for computer performance evaluation, used to measure the number of floating point operations per second. In neural networks, FLOPS is often used to evaluate the computational complexity of the model and the utilization of computing resources. It is an important indicator used to measure the computing power and efficiency of a computer. A neural network is a complex model composed of multiple layers of neurons used for tasks such as data classification, regression, and clustering. Training and inference of neural networks requires a large number of matrix multiplications, convolutions and other calculation operations, so the computational complexity is very high. FLOPS (FloatingPointOperationsperSecond) can be used to measure the computational complexity of neural networks to evaluate the computational resource usage efficiency of the model. FLOP

Explore the concepts, differences, advantages and disadvantages of RNN, LSTM and GRU Explore the concepts, differences, advantages and disadvantages of RNN, LSTM and GRU Jan 22, 2024 pm 07:51 PM

In time series data, there are dependencies between observations, so they are not independent of each other. However, traditional neural networks treat each observation as independent, which limits the model's ability to model time series data. To solve this problem, Recurrent Neural Network (RNN) was introduced, which introduced the concept of memory to capture the dynamic characteristics of time series data by establishing dependencies between data points in the network. Through recurrent connections, RNN can pass previous information into the current observation to better predict future values. This makes RNN a powerful tool for tasks involving time series data. But how does RNN achieve this kind of memory? RNN realizes memory through the feedback loop in the neural network. This is the difference between RNN and traditional neural network.

Introduction to SqueezeNet and its characteristics Introduction to SqueezeNet and its characteristics Jan 22, 2024 pm 07:15 PM

SqueezeNet is a small and precise algorithm that strikes a good balance between high accuracy and low complexity, making it ideal for mobile and embedded systems with limited resources. In 2016, researchers from DeepScale, University of California, Berkeley, and Stanford University proposed SqueezeNet, a compact and efficient convolutional neural network (CNN). In recent years, researchers have made several improvements to SqueezeNet, including SqueezeNetv1.1 and SqueezeNetv2.0. Improvements in both versions not only increase accuracy but also reduce computational costs. Accuracy of SqueezeNetv1.1 on ImageNet dataset

Compare the similarities, differences and relationships between dilated convolution and atrous convolution Compare the similarities, differences and relationships between dilated convolution and atrous convolution Jan 22, 2024 pm 10:27 PM

Dilated convolution and dilated convolution are commonly used operations in convolutional neural networks. This article will introduce their differences and relationships in detail. 1. Dilated convolution Dilated convolution, also known as dilated convolution or dilated convolution, is an operation in a convolutional neural network. It is an extension based on the traditional convolution operation and increases the receptive field of the convolution kernel by inserting holes in the convolution kernel. This way, the network can better capture a wider range of features. Dilated convolution is widely used in the field of image processing and can improve the performance of the network without increasing the number of parameters and the amount of calculation. By expanding the receptive field of the convolution kernel, dilated convolution can better process the global information in the image, thereby improving the effect of feature extraction. The main idea of ​​dilated convolution is to introduce some

Twin Neural Network: Principle and Application Analysis Twin Neural Network: Principle and Application Analysis Jan 24, 2024 pm 04:18 PM

Siamese Neural Network is a unique artificial neural network structure. It consists of two identical neural networks that share the same parameters and weights. At the same time, the two networks also share the same input data. This design was inspired by twins, as the two neural networks are structurally identical. The principle of Siamese neural network is to complete specific tasks, such as image matching, text matching and face recognition, by comparing the similarity or distance between two input data. During training, the network attempts to map similar data to adjacent regions and dissimilar data to distant regions. In this way, the network can learn how to classify or match different data to achieve corresponding

Image denoising using convolutional neural networks Image denoising using convolutional neural networks Jan 23, 2024 pm 11:48 PM

Convolutional neural networks perform well in image denoising tasks. It utilizes the learned filters to filter the noise and thereby restore the original image. This article introduces in detail the image denoising method based on convolutional neural network. 1. Overview of Convolutional Neural Network Convolutional neural network is a deep learning algorithm that uses a combination of multiple convolutional layers, pooling layers and fully connected layers to learn and classify image features. In the convolutional layer, the local features of the image are extracted through convolution operations, thereby capturing the spatial correlation in the image. The pooling layer reduces the amount of calculation by reducing the feature dimension and retains the main features. The fully connected layer is responsible for mapping learned features and labels to implement image classification or other tasks. The design of this network structure makes convolutional neural networks useful in image processing and recognition.

causal convolutional neural network causal convolutional neural network Jan 24, 2024 pm 12:42 PM

Causal convolutional neural network is a special convolutional neural network designed for causality problems in time series data. Compared with conventional convolutional neural networks, causal convolutional neural networks have unique advantages in retaining the causal relationship of time series and are widely used in the prediction and analysis of time series data. The core idea of ​​causal convolutional neural network is to introduce causality in the convolution operation. Traditional convolutional neural networks can simultaneously perceive data before and after the current time point, but in time series prediction, this may lead to information leakage problems. Because the prediction results at the current time point will be affected by the data at future time points. The causal convolutional neural network solves this problem. It can only perceive the current time point and previous data, but cannot perceive future data.

See all articles