Want to learn Machine Learning (ML), Deep Learning (DL), 5G, 6G, and PYTHON? Check out our schools below! https://www.iitk.ac.in/mwn/MLDL/index.html https://www.iitk.ac.in/mwn/IITK6G/index.html IIT Kanpur Intensive Training School (ITS) on PYTHON for Machine Learning, Neural Networks and Deep Learning 2nd to 22nd December 2023 https://www.iitk.ac.in/mwn/MLDL/index.html Welcome to the IIT Kanpur Intensive Training School (ITS) on PYTHON for Machine Learning, Neural Networks and Deep Learning. This school, spanning over 3 weeks, is an intensive program for scholars, students, faculty members, industry professionals and R&D staff aspiring to get an in-depth exposure and learn hands-on implementation of the cutting edge algorithms and software for Machine Learning (ML), Neural Networks (NN) and Deep Learning (DL) toward projects, research and placements to further their career. The school will include extensive assisted PYTHON programming sessions, and numerous important packages such as NUMPY, LINALG, MATPLOTLIB, SCIKIT-LEARN, TENSORFLOW, KERAS. The school also includes problem solving sessions to prepare for tests/ job interviews in ML and DL. For an extensive list of lecture modules and hands-on programming projects, please check the PROGRAM IIT Kanpur PYTHON + MATLAB Training School on 5G/ 6G Wireless Technologies 2nd to 22nd March 2024 https://www.iitk.ac.in/mwn/IITK6G/index.html Welcome to the PYTHON + MATLAB Training School on 5G/ 6G Wireless Technologies: MIMO, massive MIMO, mmWave MIMO, NOMA, OTFS and IRS. This is a unique cutting edge project based training school that will feature exhaustive lecture modules and several PYTHON/ MATLAB projects/ case-studies on the latest MIMO, Massive MIMO, mmWave MIMO, NOMA technologies for 5G. Also, with 5G systems being rapidly deployed around the globe, there is accelerated development of Beyond 5G (B5G) and 6G wireless technologies that break the barriers of 5G. OTFS is a cutting-edge 2D modulation technique that operates in the Delay-Doppler domain, while Intelligent reflecting surface (IRS) is another novel technology that enables dynamically altering the radio propagation environment to achieve a phenomenal boost in the capacities. Together, these dual technologies are expected to power the shift to 6G. This training school will feature exhaustive tutorial style lecture modules and several intensive supervised PYTHON/ MATLAB/ OCTAVE programming modules so that participants are able to gain practical hands-on experience of working on state-of-the-art 5G/ 6G projects All modules will be held on evenings and weekends for the convenience of participants. The extensive projects and PYTHON programming for MACHINE LEARNING (ML), NEURAL NETWORKS (NN), DEEP LEARNING (DL), 5G and 6G are of significant value to participants of all backgrounds. How do these programs benefit YOU? UG/ PG students: Learn the latest programming techniques in PYTHON and various packages such as NUMPY, LINALG, MATPLOTLIB, PANDAS, SCIKIT-LEARN, SEABORN, TENSORFLOW, KERAS together with practical ML/ NN / DL/ 5G/ 6G knowledge for projects/ thesis and also to gain an unbeatable edge in placements! PhD Scholars/ Faculty members: Use PYTHON, and various packages such as NUMPY, LINALG, MATPLOTLIB, PANDAS, SCIKIT-LEARN, SEABORN, TENSORFLOW, KERAS for research and also to establish virtual labs or for project guidance in ML/ NN / DL/ 5G/ 6G Technologies with real world datasets! Industry Professionals: Take your skills to the next level by learning PYTHON, and various packages such as NUMPY, LINALG, MATPLOTLIB, PANDAS, SCIKITLEARN, SEABORN, TENSORFLOW, KERAS, together with principles of Module Design and Analysis using Practical Data Sets for ML/ NN / DL/ 5G/ 6G Technologies! Learn the latest ML/ NN/ DL/ 5G/ 6G Algorithms, PYTHON Programming & Libraries from experts at IIT Kanpur PYTHON, Machine Learning, Neural Networks, Deep Learning, 5G and 6G are the top skills for placements in leading global MNCs such as Google, Amazon, facebook, Microsoft, Qualcomm, Broadcom, Samsung, Mediatek and many others! Our industry participants have come from top global MNCs, Indian R&D Labs below and many more! Our academic participants have come from IITs, NITs, top national and international educational institutions and more! Contact Us: e-mail: [email protected] Join/ follow us on our social media sites https://www.facebook.com/people/MWN-Lab-IIT-Kanpur/100063786175713/ https://twitter.com/LabMwn https://www.linkedin.com/in/mwn-lab-7236231ba/?originalSubdomain=in
Hello, welcome to another module in this massive open online course. So, we are looking at
MIMO beamforming, how to design the optimal transmit and receive beamformers in a multiple
input multiple output wireless communication system. So, let us continue our discussion.
So, what we want to look at is, we want to look at MIMO beamforming. So, this is the
MIMO beamforming and we have said after combining with U bar Hermitian, U bar is the receive
beamformer, we have U bar Hermitian H V bar times X plus U bar Hermitian noise, this is
the noise vector. Now, what we have to do is, this is your receive beamformer and U
bar and V bar is the transmit beamformer and we want to design this to max jointly
design transmit and receive beamformers to maximize SNR. First, what we will do is, we
will set H V bar, we will set this quantity equal to H bar. And now, you will observe
something interesting, this becomes U bar Hermitian H bar into X plus U bar Hermitian
times N bar. Now, if you see this H bar, this effectively becomes a single input multiple
output system by setting H V bar equal to H bar, this effectively becoming a SIMO system
or a multiple, simply multiple receive antenna system, for which we already know the optimal
beamformer effectively becomes your multiple R X antenna system.
And once it becomes an R X antenna system, what you have is that, this is equal to now
therefore, now you know what is optimal beamformer U bar, the optimal beamformer U bar for this
multiple antenna system, optimal R X beamformer is the maximal ratio combiner, that is U bar
equals H bar divided by norm H bar. And therefore, we know this is the maximal ratio combiner,
this is your optimal beamformer maximal, this is the maximal ratio combiner.
And the output SNR of the maximal ratio combiner is given as norm H bar square P over sigma
square, remember P is the transmit power, sigma is the noise power. So, this quantity
is constant P over sigma square, because P is the transmit power, sigma square is
the noise power, implies that we have to maximize norm H bar square. So, to maximize the SNR,
we have to maximize norm H bar square. So, in order to maximize SNR, so that is optimization
problem, maximize or let us say maximize output SNR, we have to maximize norm H bar square
but, H bar equals, we have seen H bar equals H times V bar or capital H times V bar.
So, H bar equals H times V bar, which basically implies substituting this, we have to maximize
norm H times V bar square, which is basically norm H times V bar square. And what is norm
H times V bar square, H times V bar square is the vector Hermitian itself for a complex
vector, which is basically V bar Hermitian H Hermitian H into V bar, which is equal to
V bar Hermitian G into V bar. So, we have to maximize this quantity, where what is G,
G equals H Hermitian H, G equals H Hermitian H and we have to maximize.
So, optimization problem, so the net optimization problem becomes, maximize V Hermitian G V
subject to the constraint, remember the constraint is still there, unit norm constraint that
is the transmit beam former, energy of the transmit beam former or power of the transmit
beam former, norm V bar is less than or equal to 1. So, this is the resulting problem for
optimal beam former, we have substituted H bar equals H times V bar and from that you
derive this in terms of the optimal, this optimization problem for the optimal beam
former. And now to just to simplify it, what I am
going to do is, I am going to assume real vector, so I am going to replace this Hermitian
by transpose. So, I am going to say to simplify, consider real vector, so this becomes V bar
transpose G V bar subject to the constraint, norm V bar less than 1 or norm V bar square
less than equal to 1, both these constraints are equivalent. And observe that interestingly,
this is a non convex problem, this is one of the few and very interesting non convex
problems, because if you look at this V bar transpose G V bar is a convex function.
However, we are maximizing it, we are not minimizing, remember standard form convex
optimization problem, you have a convex objective, but you are minimizing it. Here, a convex
objective you are maximizing, so the problem is a non convex problem, although the objective
is convex, because you are maximizing it, it is a non convex. In fact, if you minimize
it, you have to take the minimum and minimize it, but once you take the minimum, the convex
objective becomes a concave objective. And therefore, it is a non convex problem.
And therefore, it is because G is a positive semi definite matrix, G equals a PSD matrix
and V bar transpose G V bar equals convex. However, what you are doing is, you are minimizing
a convex objective, you are performing minimization over a convex objective function implies that
this is non convex. And therefore, now what we will do is, we will form the Lagrangian,
the same thing that we have done before, that is f of V bar comma lambda, remember you have
the objective V bar transpose G V bar plus lambda times 1 minus norm V bar square objective
plus plus Lagrange multiplier times constraint, this is equal to V bar transpose G V bar plus
lambda times 1 minus V bar transpose V bar. Now, differentiate it, take its gradient with
respect to V bar, this V bar transpose G V bar twice G V bar plus gradient of lambda
with respect to V bar is 0 minus lambda derivative V bar transpose V bar is twice V bar minus
twice V bar or in fact minus twice lambda V bar, this is equal to 1.
Now, if you solve that, the 2's cancel and therefore, this implies that G V bar equals
lambda times V bar and then you observe something very interesting, what you observe is that
G V bar equals lambda V bar. And recall, you have already seen this kind of equation, this
equation before, this is nothing but the definition of the Eigen vector of G, that is any vector
V bar, which satisfy this property, that is G times V bar vector equals simply a scaling
factor lambda times V bar, V bar is the Eigen vector and lambda is the Eigen value and so
that is the interesting property. So, what this shows is that the optimal transmit
vector V bar equals Eigen value of G equals, now you can write H Hermitian H, that was
just for simplicity. So, this is the Eigen vector of H Hermitian H, this is an Eigen
vector of H Hermitian H, but correct. So, this has many Eigen values, now which Eigen
value, now how to find which Eigen value or you can say how to find the Lagrange multiplier
lambda. So, we can say that this will be V transpose G V bar, now G V bar equals lambda
V bar, so this because V transpose lambda into V bar, which is lambda times V transpose
V bar, which is lambda times norm V bar square, but norm V bar square equal to 1, so this
becomes lambda. So, this is lambda and we want to maximize this, we want to maximize
V bar transpose G V bar implies choose the maximum lambda or choose Eigen vector corresponding
to maximum lambda Eigen value of H Hermitian H.
That is let us say, we can denote this by lambda max of G, which is lambda max of H
Hermitian H, G is H Hermitian H and that is something that is extremely interesting, what
you have, what it says is the transmit beam former H Hermitian H corresponds to the Eigen
value corresponding to the maximum Eigen vector of H Hermitian H, that is the transmit beam
former V bar, unit norm transmit beam former V bar, which maximizes the SNR at the receiver.
So, choose V bar unit norm choose V bar equals unit norm Eigen vector corresponding to maximum
Eigen value of corresponding to the maximum Eigen value of H Hermitian H, that is the
interesting aspect. This is also term, this Eigen vector corresponding to the largest
Eigen value, this is also termed as the principal Eigen vector, transmit beam former V Hermitian
transmit beam former V bar is the principal Eigen vector corresponding to H Hermitian
H. Now, what about U bar the receive beam former,
remember U bar receive beam former, we still have to find that, that is H V bar divided
by norm H V bar. Now, this norm is simply a normalization, so for the time being ignore
this that U tilde equals H V bar. Now, look at this, now perform H H Hermitian U tilde
equals H H Hermitian into H V bar, but V bar is Eigen vector of H Hermitian H. So, this
will become H, now look at this H Hermitian H V bar is equal to lambda V bar, so this
is lambda times H V bar, but H V bar is U tilde. So, what we have here is, we have showed
something very interesting H H Hermitian U tilde equals lambda times U tilde implies
U tilde is the, that is the receive beam former U tilde is the Eigen vector of the matrix
H H Hermitian. And that is something that is interesting U tilde, again you can say
U tilde or now you can say U tilde equals principal Eigen vector of H H Hermitian.
That is Eigen vector corresponding to largest Eigen value of H H Hermitian and now U bar
is simply U tilde divided by norm of U tilde, which is principal Eigen vector with unit
norm. Remember, you can simply scale the Eigen vector by any quantity, it will still be an
Eigen vector. So, this is the you can say principal Eigen vector of H H Hermitian with
this is the principal Eigen vector of H H Hermitian with unit norm, great.
And therefore, that basically gives us both the transmit and receive beam former and we
have very interesting expressions for them, the transmit beam former U bar optimal transmit
beam former. So, to summarize you have the MIMO beam forming problem Y bar equals H X
bar plus N bar X bar equals. So, this is V bar times X plus N bar that is your Y bar
and at the receiver you perform U bar Hermitian V bar Y bar, which is U bar Hermitian H V
bar X plus U bar Hermitian N bar. And remember what you are doing here is as I already told
you, you have to perform beam forming at both the ends in the MIMO system. So, you have
the transmitter, you have the receiver, you are transmitting from the transmitter in a
particular direction at the receiver, you are also collecting or you are also processing
the signal, you are steering the receive antenna array in a particular direction. So, this
is basically your transmit steering, remember this is all electronic steering. So, you do
not need to physically steer and this is your receive steering and U bar equals Eigen vector
of H H Hermitian corresponding to larger Eigen value or principle H H Hermitian and V bar
equals principle Eigen vector of H Hermitian. Now, later what we will see is, we will see
what is known as the singular value decomposition of the channel matrix. And it will turn out
that U bar and V bar are in fact, the dominant left singular and right U bar is a dominant
left singular vector, which means singular vector corresponding to the largest singular
value. And similarly, V bar is the dominant right
singular vector, singular vector corresponding to largest singular value. In fact, we will
see later that is U bar comma V bar are the dominant singular and this is a key phrase
not Eigen vectors, but singular vectors of H from the SVD, what we call not the EVD from
the SVD, which is called the singular value decomposition. From the singular value decomposition
and further from the singular value decomposition and remember dominant singular values means
corresponding to largest singular value, dominant singular vector means corresponding to the
largest singular value. And in this context also we have seen a very
interesting optimization problem that is, if you take a positive semi definite matrix
X bar transpose A X maximize subject to the constraint norm X bar equal to 1 or norm X
bar less than equal to 1, then X bar equals principle Eigen vector provided A is positive
semi definite. Remember X bar transpose X provided A is PSD positive semi definite matrix
provided X bar is a positive semi definite matrix, this is a principle Eigen vector of
A that is the maximum. Now, similarly if you minimize, now this another
interesting analog, now this problem is convex minimize X bar transpose X bar such that norm
X bar of course, is not convex again in the sense that the constraint is not convex norm
X bar greater than or equal to 1, then X bar equals Eigen vector corresponding to smallest
Eigen value. So, there are there is a analogous problem Eigen vector corresponding to X bar
equals Eigen vector corresponding to the smallest Eigen value.
And therefore, this is a very interesting application as we have seen here that is basically
with respect to beam forming in a MIMO system to determine the optimal transmit and the
unit norm transmit and receive beam formers which are given as V bar that optimal transmit
beam former is the principle Eigen vector of H Hermitian H or you can also say the dominant
left singular vector of H and U bar is the principle Eigen vector of H H Hermitian that
is the dominant left singular vector of H the channel matrix H is the channel matrix
of the MIMO wireless system. So, with this interesting observation or this completing
after completing this interesting example, we will stop here and we will continue in
the subsequent modules. Thank you very much.
.