<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/api.php?action=feedcontributions&amp;feedformat=atom&amp;user=User</id>
		<title>Psyc 40 Wiki - User contributions [en]</title>
		<link rel="self" type="application/atom+xml" href="http://brainengineering.dartmouth.edu/psyc40wiki/api.php?action=feedcontributions&amp;feedformat=atom&amp;user=User"/>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php/Special:Contributions/User"/>
		<updated>2026-08-18T03:52:04Z</updated>
		<subtitle>User contributions</subtitle>
		<generator>MediaWiki 1.29.2</generator>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=778</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=778"/>
				<updated>2025-11-20T16:00:30Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* How the Blue Brain Project Was Used in Case Study */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further. &amp;lt;ref&amp;gt;‌Blue Brain Project. “Blue Brain Project.” EPFL,&lt;br /&gt;
https://bluebrain.epfl.ch/bbp/research/domains/bluebrain/ &amp;lt;/ref&amp;gt;&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Parts of the Project ===&lt;br /&gt;
The project has many complicated parts that make it function. To begin, the project was considered finished when the following algorithms were complete. First, the volumes and dimensions of the brain had to be generated. Then the neurons had to be populated for each brain region. The cell types then had to be defined. Next, the dendrites, projections of a neuron that receive signals from other neurons, had to be computationally grown. Other parts of the brain, such as axons (parts of a neuron that transfer information from the cell body to other neurons) and synapses (where two neurons communicate with each other), had to be produced. Finally, the neurons, brain regions, and brain systems of the mouse brain had to be simulated on supercomputers. It is important to note that digital brains are not copies of the actual brain. Rather, they are representations of the brain. However, replicating the whole brain is extremely difficult, as the brain has so many parts. That is why the researchers behind the Blue Brain Project had to tackle the issue in multiple steps. The brain had to first be filled with neurons. Here is where the fact that they were replicating a mouse brain was essential. The human brain has about a thousand times more neurons than the mouse brain. So filling the digital brain with neurons for a mouse was easier than for a human. The next step was to actually grow the dendrites and axons. Then they had to find where to connect the dendrites and axons so they could put the synapses in the proper locations. The final step to get the digital brain to work like a real brain was to turn it on with specific electrical behavior. All of these steps were done by generalizing the available data about the brain. It would be extremely time-consuming to find all the possible data about the brain, so the Blue Brain Project took the information they had and generalized it to the brain as a whole.&lt;br /&gt;
&lt;br /&gt;
=== Milestones ===&lt;br /&gt;
Throughout the process of creating this digital brain, the team faced many milestones that inspired them to keep going. For instance, the scientists were able to grow parts of the brain, such as dendrites, with mathematical models. Also, when connecting brain regions, the scientists were able to do so algorithmically. When the digital brain was created, the researchers were able to mimic actual biological experiments, which allowed them to conclude that their digital brain was viable. Therefore, all of the automations helped the project efficiently take form.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Can Help Society ==&lt;br /&gt;
The Blue Brain Project is a technological advancement that can be used in various ways to help people. Specifically, simulation neuroscience is a helpful tool to study the brain without having to use an actual, physical brain. This can then be used to study the brain’s diseases and how to best tackle them. Today, there exist virtual labs where users can explore parts of the brain. The hope is that in the future, people will be able to build and simulate brains for all species, genders, and ages. The Blue Brain Project is a step closer to simulating the brain for everyone.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic2.jpg|thumb|This image shows neural simulation in the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Why Simulate the Brain? ===&lt;br /&gt;
Simulating the brain is not the same as studying the brain, so why do researchers want to do it? The main reason is that the brain has too many parts. It would take a long time to map every part of the brain through experiments. The Blue Brain Project tackles this problem by using available data collected by neuroscientists and trying to fill in the gaps of knowledge. That is where simulation comes into play. People do not need to know every little detail about the brain to be able to simulate an accurate brain.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== How the Blue Brain Project Was Used in Case Study ===&lt;br /&gt;
The technology that came out of the Blue Brain Project was used many times in different case studies. For example, in a case study led by Andras Ecker and Daniela Egas Santander, the researchers used a computer model of cortex that had a representation of real neurons, dendrites, and synapses. Then they added a calcium-based learning rule to watch how learning occurs in a large network of neurons. The researchers ended up discovering that during learning, the synapses did not all change at the same time. Only the specific ones needed for learning changed. They showed that dendrites and the structure of the network work together to learn at a larger scale.&amp;lt;ref&amp;gt;Ecker, A., Santander, D. E., Marwan Abdellah, Alonso, J. B., Sirio Bolaños-Puchet,&lt;br /&gt;
Chindemi, G., Dhuruva Priyan Gowri Mariyappan, Isbister, J. B., King, J. G., Pramod Kumbhar, Ioannis Magkanaris, Muller, E. B., &amp;amp; Reimann, M. W. (2024). Assemblies, synapse clustering, and network topology interact with plasticity to explain structure-function relationships of the cortical connectome. ELife, 13. https://doi.org/10.7554/elife.101850&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
== Downfalls of the Blue Brain Project ==&lt;br /&gt;
&lt;br /&gt;
=== Ethical Concerns ===&lt;br /&gt;
The Blue Brain Project was a massive effort that resulted in significant development and knowledge. However, with that, certain norms were sacrificed. For example, the carbon footprint from the project is a major issue. The computers and data used for the project generated notable carbon emissions. Therefore, while the research is progressing, the natural environment’s health is being overlooked. &lt;br /&gt;
Also, for the project, a lot of data had to be collected from animal brains to validate the digital models. While animal data is necessary to see whether the digital models are accurate, people raise concerns about the ethics of all animal experimentation. There has to be a line drawn between animal testing and scientific development. &lt;br /&gt;
Finally, people do not know a lot about consciousness and what results in a conscious brain. Therefore, there is always a risk that the simulated brains will result in consciousness. This can raise questions about how people should treat the digital models if they do have partial consciousness.&amp;lt;ref&amp;gt;‌Perera, S. (2023). The blue brain project: pioneering the frontier of brain simulation. AIMS&lt;br /&gt;
Neuroscience, https://doi.org/10.3934/neuroscience.2023024&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
=== Unanswered Questions ===&lt;br /&gt;
There are certain questions that the Blue Brain Project cannot answer yet. To start, the researchers were able to simulate the mouse brain, but to expand that knowledge to a human brain, people would need stronger computers. This technology is not yet available, making the journey to scaling up to a human brain extremely challenging. Additionally, the Blue Brain Project has a lot of data, yet people still do not know how to explain certain brain functions, such as thoughts, memory, and emotions. People cannot accurately pinpoint how neurons and synapses connect to achieve these higher-level brain functions.&lt;br /&gt;
&lt;br /&gt;
== Conclusion ==&lt;br /&gt;
The Blue Brain Project is an important step in neuroscience. Although there are still many mysteries about the brain, any step towards understanding is a crucial one. The mouse brain is a mammal brain, so although quite different, the mouse can be a step closer to understanding the human brain. One day, there will be enough knowledge, technology, and time to fully explain how the human brain functions. The Blue Brain Project will be a part of the history that helps people gain a deeper understanding.&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=777</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=777"/>
				<updated>2025-11-20T15:59:54Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* How the Blue Brain Project Was Used in Case Study */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further. &amp;lt;ref&amp;gt;‌Blue Brain Project. “Blue Brain Project.” EPFL,&lt;br /&gt;
https://bluebrain.epfl.ch/bbp/research/domains/bluebrain/ &amp;lt;/ref&amp;gt;&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Parts of the Project ===&lt;br /&gt;
The project has many complicated parts that make it function. To begin, the project was considered finished when the following algorithms were complete. First, the volumes and dimensions of the brain had to be generated. Then the neurons had to be populated for each brain region. The cell types then had to be defined. Next, the dendrites, projections of a neuron that receive signals from other neurons, had to be computationally grown. Other parts of the brain, such as axons (parts of a neuron that transfer information from the cell body to other neurons) and synapses (where two neurons communicate with each other), had to be produced. Finally, the neurons, brain regions, and brain systems of the mouse brain had to be simulated on supercomputers. It is important to note that digital brains are not copies of the actual brain. Rather, they are representations of the brain. However, replicating the whole brain is extremely difficult, as the brain has so many parts. That is why the researchers behind the Blue Brain Project had to tackle the issue in multiple steps. The brain had to first be filled with neurons. Here is where the fact that they were replicating a mouse brain was essential. The human brain has about a thousand times more neurons than the mouse brain. So filling the digital brain with neurons for a mouse was easier than for a human. The next step was to actually grow the dendrites and axons. Then they had to find where to connect the dendrites and axons so they could put the synapses in the proper locations. The final step to get the digital brain to work like a real brain was to turn it on with specific electrical behavior. All of these steps were done by generalizing the available data about the brain. It would be extremely time-consuming to find all the possible data about the brain, so the Blue Brain Project took the information they had and generalized it to the brain as a whole.&lt;br /&gt;
&lt;br /&gt;
=== Milestones ===&lt;br /&gt;
Throughout the process of creating this digital brain, the team faced many milestones that inspired them to keep going. For instance, the scientists were able to grow parts of the brain, such as dendrites, with mathematical models. Also, when connecting brain regions, the scientists were able to do so algorithmically. When the digital brain was created, the researchers were able to mimic actual biological experiments, which allowed them to conclude that their digital brain was viable. Therefore, all of the automations helped the project efficiently take form.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Can Help Society ==&lt;br /&gt;
The Blue Brain Project is a technological advancement that can be used in various ways to help people. Specifically, simulation neuroscience is a helpful tool to study the brain without having to use an actual, physical brain. This can then be used to study the brain’s diseases and how to best tackle them. Today, there exist virtual labs where users can explore parts of the brain. The hope is that in the future, people will be able to build and simulate brains for all species, genders, and ages. The Blue Brain Project is a step closer to simulating the brain for everyone.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic2.jpg|thumb|This image shows neural simulation in the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Why Simulate the Brain? ===&lt;br /&gt;
Simulating the brain is not the same as studying the brain, so why do researchers want to do it? The main reason is that the brain has too many parts. It would take a long time to map every part of the brain through experiments. The Blue Brain Project tackles this problem by using available data collected by neuroscientists and trying to fill in the gaps of knowledge. That is where simulation comes into play. People do not need to know every little detail about the brain to be able to simulate an accurate brain.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== How the Blue Brain Project Was Used in Case Study ===&lt;br /&gt;
The technology that came out of the Blue Brain Project was used many times in different case studies. For example, in a case study led by Andras Ecker and Daniela Egas Santander, the researchers used a computer model of cortex that had a representation of real neurons, dendrites, and synapses. Then they added a calcium-based learning rule to watch how learning occurs in a large network of neurons. The researchers ended up learning that during learning, the synapses did not all change at the same time. Only the specific ones needed for learning changed. They showed that dendrites and the structure of the network work together to learn at a larger scale.&amp;lt;ref&amp;gt;Ecker, A., Santander, D. E., Marwan Abdellah, Alonso, J. B., Sirio Bolaños-Puchet,&lt;br /&gt;
Chindemi, G., Dhuruva Priyan Gowri Mariyappan, Isbister, J. B., King, J. G., Pramod Kumbhar, Ioannis Magkanaris, Muller, E. B., &amp;amp; Reimann, M. W. (2024). Assemblies, synapse clustering, and network topology interact with plasticity to explain structure-function relationships of the cortical connectome. ELife, 13. https://doi.org/10.7554/elife.101850&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
== Downfalls of the Blue Brain Project ==&lt;br /&gt;
&lt;br /&gt;
=== Ethical Concerns ===&lt;br /&gt;
The Blue Brain Project was a massive effort that resulted in significant development and knowledge. However, with that, certain norms were sacrificed. For example, the carbon footprint from the project is a major issue. The computers and data used for the project generated notable carbon emissions. Therefore, while the research is progressing, the natural environment’s health is being overlooked. &lt;br /&gt;
Also, for the project, a lot of data had to be collected from animal brains to validate the digital models. While animal data is necessary to see whether the digital models are accurate, people raise concerns about the ethics of all animal experimentation. There has to be a line drawn between animal testing and scientific development. &lt;br /&gt;
Finally, people do not know a lot about consciousness and what results in a conscious brain. Therefore, there is always a risk that the simulated brains will result in consciousness. This can raise questions about how people should treat the digital models if they do have partial consciousness.&amp;lt;ref&amp;gt;‌Perera, S. (2023). The blue brain project: pioneering the frontier of brain simulation. AIMS&lt;br /&gt;
Neuroscience, https://doi.org/10.3934/neuroscience.2023024&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
=== Unanswered Questions ===&lt;br /&gt;
There are certain questions that the Blue Brain Project cannot answer yet. To start, the researchers were able to simulate the mouse brain, but to expand that knowledge to a human brain, people would need stronger computers. This technology is not yet available, making the journey to scaling up to a human brain extremely challenging. Additionally, the Blue Brain Project has a lot of data, yet people still do not know how to explain certain brain functions, such as thoughts, memory, and emotions. People cannot accurately pinpoint how neurons and synapses connect to achieve these higher-level brain functions.&lt;br /&gt;
&lt;br /&gt;
== Conclusion ==&lt;br /&gt;
The Blue Brain Project is an important step in neuroscience. Although there are still many mysteries about the brain, any step towards understanding is a crucial one. The mouse brain is a mammal brain, so although quite different, the mouse can be a step closer to understanding the human brain. One day, there will be enough knowledge, technology, and time to fully explain how the human brain functions. The Blue Brain Project will be a part of the history that helps people gain a deeper understanding.&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=776</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=776"/>
				<updated>2025-11-20T15:57:11Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* Parts of the Project */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further. &amp;lt;ref&amp;gt;‌Blue Brain Project. “Blue Brain Project.” EPFL,&lt;br /&gt;
https://bluebrain.epfl.ch/bbp/research/domains/bluebrain/ &amp;lt;/ref&amp;gt;&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Parts of the Project ===&lt;br /&gt;
The project has many complicated parts that make it function. To begin, the project was considered finished when the following algorithms were complete. First, the volumes and dimensions of the brain had to be generated. Then the neurons had to be populated for each brain region. The cell types then had to be defined. Next, the dendrites, projections of a neuron that receive signals from other neurons, had to be computationally grown. Other parts of the brain, such as axons (parts of a neuron that transfer information from the cell body to other neurons) and synapses (where two neurons communicate with each other), had to be produced. Finally, the neurons, brain regions, and brain systems of the mouse brain had to be simulated on supercomputers. It is important to note that digital brains are not copies of the actual brain. Rather, they are representations of the brain. However, replicating the whole brain is extremely difficult, as the brain has so many parts. That is why the researchers behind the Blue Brain Project had to tackle the issue in multiple steps. The brain had to first be filled with neurons. Here is where the fact that they were replicating a mouse brain was essential. The human brain has about a thousand times more neurons than the mouse brain. So filling the digital brain with neurons for a mouse was easier than for a human. The next step was to actually grow the dendrites and axons. Then they had to find where to connect the dendrites and axons so they could put the synapses in the proper locations. The final step to get the digital brain to work like a real brain was to turn it on with specific electrical behavior. All of these steps were done by generalizing the available data about the brain. It would be extremely time-consuming to find all the possible data about the brain, so the Blue Brain Project took the information they had and generalized it to the brain as a whole.&lt;br /&gt;
&lt;br /&gt;
=== Milestones ===&lt;br /&gt;
Throughout the process of creating this digital brain, the team faced many milestones that inspired them to keep going. For instance, the scientists were able to grow parts of the brain, such as dendrites, with mathematical models. Also, when connecting brain regions, the scientists were able to do so algorithmically. When the digital brain was created, the researchers were able to mimic actual biological experiments, which allowed them to conclude that their digital brain was viable. Therefore, all of the automations helped the project efficiently take form.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Can Help Society ==&lt;br /&gt;
The Blue Brain Project is a technological advancement that can be used in various ways to help people. Specifically, simulation neuroscience is a helpful tool to study the brain without having to use an actual, physical brain. This can then be used to study the brain’s diseases and how to best tackle them. Today, there exist virtual labs where users can explore parts of the brain. The hope is that in the future, people will be able to build and simulate brains for all species, genders, and ages. The Blue Brain Project is a step closer to simulating the brain for everyone.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic2.jpg|thumb|This image shows neural simulation in the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Why Simulate the Brain? ===&lt;br /&gt;
Simulating the brain is not the same as studying the brain, so why do researchers want to do it? The main reason is that the brain has too many parts. It would take a long time to map every part of the brain through experiments. The Blue Brain Project tackles this problem by using available data collected by neuroscientists and trying to fill in the gaps of knowledge. That is where simulation comes into play. People do not need to know every little detail about the brain to be able to simulate an accurate brain.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== How the Blue Brain Project Was Used in Case Study ===&lt;br /&gt;
The technology that came out of the Blue Brain Project was used many times in different case studies. For example in a case study led by Andras Ecker and Daniela Egas Santander, the researchers used a computer model of cortex that had a representation of real neurons, dendrites, and synapses. Then they added a calcium-based learning rule to watch how learning occurs in a large network of neurons. The researchers ended up learning that during learning, the synapses did not all change at the same time. Only the specific ones needed for learning changed. They showed that dendrites and the structure of the network work together to learn at a larger scale.&amp;lt;ref&amp;gt;Ecker, A., Santander, D. E., Marwan Abdellah, Alonso, J. B., Sirio Bolaños-Puchet,&lt;br /&gt;
Chindemi, G., Dhuruva Priyan Gowri Mariyappan, Isbister, J. B., King, J. G., Pramod Kumbhar, Ioannis Magkanaris, Muller, E. B., &amp;amp; Reimann, M. W. (2024). Assemblies, synapse clustering, and network topology interact with plasticity to explain structure-function relationships of the cortical connectome. ELife, 13. https://doi.org/10.7554/elife.101850&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Downfalls of the Blue Brain Project ==&lt;br /&gt;
&lt;br /&gt;
=== Ethical Concerns ===&lt;br /&gt;
The Blue Brain Project was a massive effort that resulted in significant development and knowledge. However, with that, certain norms were sacrificed. For example, the carbon footprint from the project is a major issue. The computers and data used for the project generated notable carbon emissions. Therefore, while the research is progressing, the natural environment’s health is being overlooked. &lt;br /&gt;
Also, for the project, a lot of data had to be collected from animal brains to validate the digital models. While animal data is necessary to see whether the digital models are accurate, people raise concerns about the ethics of all animal experimentation. There has to be a line drawn between animal testing and scientific development. &lt;br /&gt;
Finally, people do not know a lot about consciousness and what results in a conscious brain. Therefore, there is always a risk that the simulated brains will result in consciousness. This can raise questions about how people should treat the digital models if they do have partial consciousness.&amp;lt;ref&amp;gt;‌Perera, S. (2023). The blue brain project: pioneering the frontier of brain simulation. AIMS&lt;br /&gt;
Neuroscience, https://doi.org/10.3934/neuroscience.2023024&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
=== Unanswered Questions ===&lt;br /&gt;
There are certain questions that the Blue Brain Project cannot answer yet. To start, the researchers were able to simulate the mouse brain, but to expand that knowledge to a human brain, people would need stronger computers. This technology is not yet available, making the journey to scaling up to a human brain extremely challenging. Additionally, the Blue Brain Project has a lot of data, yet people still do not know how to explain certain brain functions, such as thoughts, memory, and emotions. People cannot accurately pinpoint how neurons and synapses connect to achieve these higher-level brain functions.&lt;br /&gt;
&lt;br /&gt;
== Conclusion ==&lt;br /&gt;
The Blue Brain Project is an important step in neuroscience. Although there are still many mysteries about the brain, any step towards understanding is a crucial one. The mouse brain is a mammal brain, so although quite different, the mouse can be a step closer to understanding the human brain. One day, there will be enough knowledge, technology, and time to fully explain how the human brain functions. The Blue Brain Project will be a part of the history that helps people gain a deeper understanding.&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=774</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=774"/>
				<updated>2025-11-20T15:50:53Z</updated>
		
		<summary type="html">&lt;p&gt;User: User moved page Blue Brain Project to Blue Brain Project By: Sasha Bryukhova&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further. &amp;lt;ref&amp;gt;‌Blue Brain Project. “Blue Brain Project.” EPFL,&lt;br /&gt;
https://bluebrain.epfl.ch/bbp/research/domains/bluebrain/ &amp;lt;/ref&amp;gt;&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Parts of the Project ===&lt;br /&gt;
The project has many complicated parts that make it function. To begin, the project was considered finished when the following algorithms were complete. First, the volumes and dimensions of the brain had to be generated. Then the neurons had to be populated for each brain region. The cell types then had to be defined. Next, the dendrites, projections of a neuron that receive signals from other neurons, had to be computationally grown. Other parts of the brain, such as axons (parts of a neuron that transfer information from the cell body to other neurons) and synapses (where two neurons communicate with each other), had to be produced. Finally, the neurons, brain regions, and brain systems of the mouse brain had to be simulated on supercomputers. It is important to note that digital brains are not copies of the actual brain. Rather, they are representations of the brain. However, replicating the whole brain is extremely difficult, as the brain has so many parts. That’s why the researchers behind the Blue Brain project had to tackle the issue in multiple steps. The brain had to first be filled with neurons. Here is where the fact that they were replicating a mouse brain was essential. The human brain has about a thousand times more neurons than the mouse brain. So filling the digital brain with neurons for a mouse was easier than for a human. The next step was to actually grow the dendrites and axons. Then they had to find where to connect the dendrites and axons so they could put the synapses in the proper locations. The final step to get the digital brain to work like a real brain was to turn it on with specific electrical behavior. All of these steps were done by generalizing the available data about the brain. It would be extremely time-consuming to find all the possible data about the brain, so the Blue Brain Project took the information they had and generalized it to the brain as a whole.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Milestones ===&lt;br /&gt;
Throughout the process of creating this digital brain, the team faced many milestones that inspired them to keep going. For instance, the scientists were able to grow parts of the brain, such as dendrites, with mathematical models. Also, when connecting brain regions, the scientists were able to do so algorithmically. When the digital brain was created, the researchers were able to mimic actual biological experiments, which allowed them to conclude that their digital brain was viable. Therefore, all of the automations helped the project efficiently take form.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Can Help Society ==&lt;br /&gt;
The Blue Brain Project is a technological advancement that can be used in various ways to help people. Specifically, simulation neuroscience is a helpful tool to study the brain without having to use an actual, physical brain. This can then be used to study the brain’s diseases and how to best tackle them. Today, there exist virtual labs where users can explore parts of the brain. The hope is that in the future, people will be able to build and simulate brains for all species, genders, and ages. The Blue Brain Project is a step closer to simulating the brain for everyone.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic2.jpg|thumb|This image shows neural simulation in the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Why Simulate the Brain? ===&lt;br /&gt;
Simulating the brain is not the same as studying the brain, so why do researchers want to do it? The main reason is that the brain has too many parts. It would take a long time to map every part of the brain through experiments. The Blue Brain Project tackles this problem by using available data collected by neuroscientists and trying to fill in the gaps of knowledge. That is where simulation comes into play. People do not need to know every little detail about the brain to be able to simulate an accurate brain.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== How the Blue Brain Project Was Used in Case Study ===&lt;br /&gt;
The technology that came out of the Blue Brain Project was used many times in different case studies. For example in a case study led by Andras Ecker and Daniela Egas Santander, the researchers used a computer model of cortex that had a representation of real neurons, dendrites, and synapses. Then they added a calcium-based learning rule to watch how learning occurs in a large network of neurons. The researchers ended up learning that during learning, the synapses did not all change at the same time. Only the specific ones needed for learning changed. They showed that dendrites and the structure of the network work together to learn at a larger scale.&amp;lt;ref&amp;gt;Ecker, A., Santander, D. E., Marwan Abdellah, Alonso, J. B., Sirio Bolaños-Puchet,&lt;br /&gt;
Chindemi, G., Dhuruva Priyan Gowri Mariyappan, Isbister, J. B., King, J. G., Pramod Kumbhar, Ioannis Magkanaris, Muller, E. B., &amp;amp; Reimann, M. W. (2024). Assemblies, synapse clustering, and network topology interact with plasticity to explain structure-function relationships of the cortical connectome. ELife, 13. https://doi.org/10.7554/elife.101850&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Downfalls of the Blue Brain Project ==&lt;br /&gt;
&lt;br /&gt;
=== Ethical Concerns ===&lt;br /&gt;
The Blue Brain Project was a massive effort that resulted in significant development and knowledge. However, with that, certain norms were sacrificed. For example, the carbon footprint from the project is a major issue. The computers and data used for the project generated notable carbon emissions. Therefore, while the research is progressing, the natural environment’s health is being overlooked. &lt;br /&gt;
Also, for the project, a lot of data had to be collected from animal brains to validate the digital models. While animal data is necessary to see whether the digital models are accurate, people raise concerns about the ethics of all animal experimentation. There has to be a line drawn between animal testing and scientific development. &lt;br /&gt;
Finally, people do not know a lot about consciousness and what results in a conscious brain. Therefore, there is always a risk that the simulated brains will result in consciousness. This can raise questions about how people should treat the digital models if they do have partial consciousness.&amp;lt;ref&amp;gt;‌Perera, S. (2023). The blue brain project: pioneering the frontier of brain simulation. AIMS&lt;br /&gt;
Neuroscience, https://doi.org/10.3934/neuroscience.2023024&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
=== Unanswered Questions ===&lt;br /&gt;
There are certain questions that the Blue Brain Project cannot answer yet. To start, the researchers were able to simulate the mouse brain, but to expand that knowledge to a human brain, people would need stronger computers. This technology is not yet available, making the journey to scaling up to a human brain extremely challenging. Additionally, the Blue Brain Project has a lot of data, yet people still do not know how to explain certain brain functions, such as thoughts, memory, and emotions. People cannot accurately pinpoint how neurons and synapses connect to achieve these higher-level brain functions.&lt;br /&gt;
&lt;br /&gt;
== Conclusion ==&lt;br /&gt;
The Blue Brain Project is an important step in neuroscience. Although there are still many mysteries about the brain, any step towards understanding is a crucial one. The mouse brain is a mammal brain, so although quite different, the mouse can be a step closer to understanding the human brain. One day, there will be enough knowledge, technology, and time to fully explain how the human brain functions. The Blue Brain Project will be a part of the history that helps people gain a deeper understanding.&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project&amp;diff=775</id>
		<title>Blue Brain Project</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project&amp;diff=775"/>
				<updated>2025-11-20T15:50:53Z</updated>
		
		<summary type="html">&lt;p&gt;User: User moved page Blue Brain Project to Blue Brain Project By: Sasha Bryukhova&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;#REDIRECT [[Blue Brain Project By: Sasha Bryukhova]]&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=773</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=773"/>
				<updated>2025-11-20T15:48:28Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further. &amp;lt;ref&amp;gt;‌Blue Brain Project. “Blue Brain Project.” EPFL,&lt;br /&gt;
https://bluebrain.epfl.ch/bbp/research/domains/bluebrain/ &amp;lt;/ref&amp;gt;&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Parts of the Project ===&lt;br /&gt;
The project has many complicated parts that make it function. To begin, the project was considered finished when the following algorithms were complete. First, the volumes and dimensions of the brain had to be generated. Then the neurons had to be populated for each brain region. The cell types then had to be defined. Next, the dendrites, projections of a neuron that receive signals from other neurons, had to be computationally grown. Other parts of the brain, such as axons (parts of a neuron that transfer information from the cell body to other neurons) and synapses (where two neurons communicate with each other), had to be produced. Finally, the neurons, brain regions, and brain systems of the mouse brain had to be simulated on supercomputers. It is important to note that digital brains are not copies of the actual brain. Rather, they are representations of the brain. However, replicating the whole brain is extremely difficult, as the brain has so many parts. That’s why the researchers behind the Blue Brain project had to tackle the issue in multiple steps. The brain had to first be filled with neurons. Here is where the fact that they were replicating a mouse brain was essential. The human brain has about a thousand times more neurons than the mouse brain. So filling the digital brain with neurons for a mouse was easier than for a human. The next step was to actually grow the dendrites and axons. Then they had to find where to connect the dendrites and axons so they could put the synapses in the proper locations. The final step to get the digital brain to work like a real brain was to turn it on with specific electrical behavior. All of these steps were done by generalizing the available data about the brain. It would be extremely time-consuming to find all the possible data about the brain, so the Blue Brain Project took the information they had and generalized it to the brain as a whole.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Milestones ===&lt;br /&gt;
Throughout the process of creating this digital brain, the team faced many milestones that inspired them to keep going. For instance, the scientists were able to grow parts of the brain, such as dendrites, with mathematical models. Also, when connecting brain regions, the scientists were able to do so algorithmically. When the digital brain was created, the researchers were able to mimic actual biological experiments, which allowed them to conclude that their digital brain was viable. Therefore, all of the automations helped the project efficiently take form.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Can Help Society ==&lt;br /&gt;
The Blue Brain Project is a technological advancement that can be used in various ways to help people. Specifically, simulation neuroscience is a helpful tool to study the brain without having to use an actual, physical brain. This can then be used to study the brain’s diseases and how to best tackle them. Today, there exist virtual labs where users can explore parts of the brain. The hope is that in the future, people will be able to build and simulate brains for all species, genders, and ages. The Blue Brain Project is a step closer to simulating the brain for everyone.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic2.jpg|thumb|This image shows neural simulation in the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Why Simulate the Brain? ===&lt;br /&gt;
Simulating the brain is not the same as studying the brain, so why do researchers want to do it? The main reason is that the brain has too many parts. It would take a long time to map every part of the brain through experiments. The Blue Brain Project tackles this problem by using available data collected by neuroscientists and trying to fill in the gaps of knowledge. That is where simulation comes into play. People do not need to know every little detail about the brain to be able to simulate an accurate brain.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== How the Blue Brain Project Was Used in Case Study ===&lt;br /&gt;
The technology that came out of the Blue Brain Project was used many times in different case studies. For example in a case study led by Andras Ecker and Daniela Egas Santander, the researchers used a computer model of cortex that had a representation of real neurons, dendrites, and synapses. Then they added a calcium-based learning rule to watch how learning occurs in a large network of neurons. The researchers ended up learning that during learning, the synapses did not all change at the same time. Only the specific ones needed for learning changed. They showed that dendrites and the structure of the network work together to learn at a larger scale.&amp;lt;ref&amp;gt;Ecker, A., Santander, D. E., Marwan Abdellah, Alonso, J. B., Sirio Bolaños-Puchet,&lt;br /&gt;
Chindemi, G., Dhuruva Priyan Gowri Mariyappan, Isbister, J. B., King, J. G., Pramod Kumbhar, Ioannis Magkanaris, Muller, E. B., &amp;amp; Reimann, M. W. (2024). Assemblies, synapse clustering, and network topology interact with plasticity to explain structure-function relationships of the cortical connectome. ELife, 13. https://doi.org/10.7554/elife.101850&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Downfalls of the Blue Brain Project ==&lt;br /&gt;
&lt;br /&gt;
=== Ethical Concerns ===&lt;br /&gt;
The Blue Brain Project was a massive effort that resulted in significant development and knowledge. However, with that, certain norms were sacrificed. For example, the carbon footprint from the project is a major issue. The computers and data used for the project generated notable carbon emissions. Therefore, while the research is progressing, the natural environment’s health is being overlooked. &lt;br /&gt;
Also, for the project, a lot of data had to be collected from animal brains to validate the digital models. While animal data is necessary to see whether the digital models are accurate, people raise concerns about the ethics of all animal experimentation. There has to be a line drawn between animal testing and scientific development. &lt;br /&gt;
Finally, people do not know a lot about consciousness and what results in a conscious brain. Therefore, there is always a risk that the simulated brains will result in consciousness. This can raise questions about how people should treat the digital models if they do have partial consciousness.&amp;lt;ref&amp;gt;‌Perera, S. (2023). The blue brain project: pioneering the frontier of brain simulation. AIMS&lt;br /&gt;
Neuroscience, https://doi.org/10.3934/neuroscience.2023024&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
=== Unanswered Questions ===&lt;br /&gt;
There are certain questions that the Blue Brain Project cannot answer yet. To start, the researchers were able to simulate the mouse brain, but to expand that knowledge to a human brain, people would need stronger computers. This technology is not yet available, making the journey to scaling up to a human brain extremely challenging. Additionally, the Blue Brain Project has a lot of data, yet people still do not know how to explain certain brain functions, such as thoughts, memory, and emotions. People cannot accurately pinpoint how neurons and synapses connect to achieve these higher-level brain functions.&lt;br /&gt;
&lt;br /&gt;
== Conclusion ==&lt;br /&gt;
The Blue Brain Project is an important step in neuroscience. Although there are still many mysteries about the brain, any step towards understanding is a crucial one. The mouse brain is a mammal brain, so although quite different, the mouse can be a step closer to understanding the human brain. One day, there will be enough knowledge, technology, and time to fully explain how the human brain functions. The Blue Brain Project will be a part of the history that helps people gain a deeper understanding.&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=772</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=772"/>
				<updated>2025-11-20T15:47:13Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further. &amp;lt;ref&amp;gt;‌Blue Brain Project. “Blue Brain Project.” EPFL,&lt;br /&gt;
https://bluebrain.epfl.ch/bbp/research/domains/bluebrain/ &amp;lt;/ref&amp;gt;&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Parts of the Project ===&lt;br /&gt;
The project has many complicated parts that make it function. To begin, the project was considered finished when the following algorithms were complete. First, the volumes and dimensions of the brain had to be generated. Then the neurons had to be populated for each brain region. The cell types then had to be defined. Next, the dendrites, projections of a neuron that receive signals from other neurons, had to be computationally grown. Other parts of the brain, such as axons (parts of a neuron that transfer information from the cell body to other neurons) and synapses (where two neurons communicate with each other), had to be produced. Finally, the neurons, brain regions, and brain systems of the mouse brain had to be simulated on supercomputers. It is important to note that digital brains are not copies of the actual brain. Rather, they are representations of the brain. However, replicating the whole brain is extremely difficult, as the brain has so many parts. That’s why the researchers behind the Blue Brain project had to tackle the issue in multiple steps. The brain had to first be filled with neurons. Here is where the fact that they were replicating a mouse brain was essential. The human brain has about a thousand times more neurons than the mouse brain. So filling the digital brain with neurons for a mouse was easier than for a human. The next step was to actually grow the dendrites and axons. Then they had to find where to connect the dendrites and axons so they could put the synapses in the proper locations. The final step to get the digital brain to work like a real brain was to turn it on with specific electrical behavior. All of these steps were done by generalizing the available data about the brain. It would be extremely time-consuming to find all the possible data about the brain, so the Blue Brain Project took the information they had and generalized it to the brain as a whole.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Milestones ===&lt;br /&gt;
Throughout the process of creating this digital brain, the team faced many milestones that inspired them to keep going. For instance, the scientists were able to grow parts of the brain, such as dendrites, with mathematical models. Also, when connecting brain regions, the scientists were able to do so algorithmically. When the digital brain was created, the researchers were able to mimic actual biological experiments, which allowed them to conclude that their digital brain was viable. Therefore, all of the automations helped the project efficiently take form.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Can Help Society ==&lt;br /&gt;
The Blue Brain Project is a technological advancement that can be used in various ways to help people. Specifically, simulation neuroscience is a helpful tool to study the brain without having to use an actual, physical brain. This can then be used to study the brain’s diseases and how to best tackle them. Today, there exist virtual labs where users can explore parts of the brain. The hope is that in the future, people will be able to build and simulate brains for all species, genders, and ages. The Blue Brain Project is a step closer to simulating the brain for everyone.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic2.jpg|thumb|This image shows neural simulation in the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Why Simulate the Brain? ===&lt;br /&gt;
Simulating the brain is not the same as studying the brain, so why do researchers want to do it? The main reason is that the brain has too many parts. It would take a long time to map every part of the brain through experiments. The Blue Brain Project tackles this problem by using available data collected by neuroscientists and trying to fill in the gaps of knowledge. That is where simulation comes into play. People do not need to know every little detail about the brain to be able to simulate an accurate brain.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== How the Blue Brain Project Was Used in Case Study ===&lt;br /&gt;
The technology that came out of the Blue Brain Project was used many times in different case studies. For example in a case study led by Andras Ecker and Daniela Egas Santander, the researchers used a computer model of cortex that had a representation of real neurons, dendrites, and synapses. Then they added a calcium-based learning rule to watch how learning occurs in a large network of neurons. The researchers ended up learning that during learning, the synapses did not all change at the same time. Only the specific ones needed for learning changed. They showed that dendrites and the structure of the network work together to learn at a larger scale.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Downfalls of the Blue Brain Project ==&lt;br /&gt;
&lt;br /&gt;
=== Ethical Concerns ===&lt;br /&gt;
The Blue Brain Project was a massive effort that resulted in significant development and knowledge. However, with that, certain norms were sacrificed. For example, the carbon footprint from the project is a major issue. The computers and data used for the project generated notable carbon emissions. Therefore, while the research is progressing, the natural environment’s health is being overlooked. &lt;br /&gt;
Also, for the project, a lot of data had to be collected from animal brains to validate the digital models. While animal data is necessary to see whether the digital models are accurate, people raise concerns about the ethics of all animal experimentation. There has to be a line drawn between animal testing and scientific development. &lt;br /&gt;
Finally, people do not know a lot about consciousness and what results in a conscious brain. Therefore, there is always a risk that the simulated brains will result in consciousness. This can raise questions about how people should treat the digital models if they do have partial consciousness.&amp;lt;ref&amp;gt;‌Perera, S. (2023). The blue brain project: pioneering the frontier of brain simulation. AIMS&lt;br /&gt;
Neuroscience, https://doi.org/10.3934/neuroscience.2023024&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
=== Unanswered Questions ===&lt;br /&gt;
There are certain questions that the Blue Brain Project cannot answer yet. To start, the researchers were able to simulate the mouse brain, but to expand that knowledge to a human brain, people would need stronger computers. This technology is not yet available, making the journey to scaling up to a human brain extremely challenging. Additionally, the Blue Brain Project has a lot of data, yet people still do not know how to explain certain brain functions, such as thoughts, memory, and emotions. People cannot accurately pinpoint how neurons and synapses connect to achieve these higher-level brain functions.&lt;br /&gt;
&lt;br /&gt;
== Conclusion ==&lt;br /&gt;
The Blue Brain Project is an important step in neuroscience. Although there are still many mysteries about the brain, any step towards understanding is a crucial one. The mouse brain is a mammal brain, so although quite different, the mouse can be a step closer to understanding the human brain. One day, there will be enough knowledge, technology, and time to fully explain how the human brain functions. The Blue Brain Project will be a part of the history that helps people gain a deeper understanding.&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=771</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=771"/>
				<updated>2025-11-20T15:44:59Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further. &amp;lt;ref&amp;gt;‌Blue Brain Project. “Blue Brain Project.” EPFL,&lt;br /&gt;
https://bluebrain.epfl.ch/bbp/research/domains/bluebrain/ &amp;lt;/ref&amp;gt;&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Parts of the Project ===&lt;br /&gt;
The project has many complicated parts that make it function. To begin, the project was considered finished when the following algorithms were complete. First, the volumes and dimensions of the brain had to be generated. Then the neurons had to be populated for each brain region. The cell types then had to be defined. Next, the dendrites, projections of a neuron that receive signals from other neurons, had to be computationally grown. Other parts of the brain, such as axons (parts of a neuron that transfer information from the cell body to other neurons) and synapses (where two neurons communicate with each other), had to be produced. Finally, the neurons, brain regions, and brain systems of the mouse brain had to be simulated on supercomputers. It is important to note that digital brains are not copies of the actual brain. Rather, they are representations of the brain. However, replicating the whole brain is extremely difficult, as the brain has so many parts. That’s why the researchers behind the Blue Brain project had to tackle the issue in multiple steps. The brain had to first be filled with neurons. Here is where the fact that they were replicating a mouse brain was essential. The human brain has about a thousand times more neurons than the mouse brain. So filling the digital brain with neurons for a mouse was easier than for a human. The next step was to actually grow the dendrites and axons. Then they had to find where to connect the dendrites and axons so they could put the synapses in the proper locations. The final step to get the digital brain to work like a real brain was to turn it on with specific electrical behavior. All of these steps were done by generalizing the available data about the brain. It would be extremely time-consuming to find all the possible data about the brain, so the Blue Brain Project took the information they had and generalized it to the brain as a whole.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Milestones ===&lt;br /&gt;
Throughout the process of creating this digital brain, the team faced many milestones that inspired them to keep going. For instance, the scientists were able to grow parts of the brain, such as dendrites, with mathematical models. Also, when connecting brain regions, the scientists were able to do so algorithmically. When the digital brain was created, the researchers were able to mimic actual biological experiments, which allowed them to conclude that their digital brain was viable. Therefore, all of the automations helped the project efficiently take form.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Can Help Society ==&lt;br /&gt;
The Blue Brain Project is a technological advancement that can be used in various ways to help people. Specifically, simulation neuroscience is a helpful tool to study the brain without having to use an actual, physical brain. This can then be used to study the brain’s diseases and how to best tackle them. Today, there exist virtual labs where users can explore parts of the brain. The hope is that in the future, people will be able to build and simulate brains for all species, genders, and ages. The Blue Brain Project is a step closer to simulating the brain for everyone.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic2.jpg|thumb|This image shows neural simulation in the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Why Simulate the Brain? ===&lt;br /&gt;
Simulating the brain is not the same as studying the brain, so why do researchers want to do it? The main reason is that the brain has too many parts. It would take a long time to map every part of the brain through experiments. The Blue Brain Project tackles this problem by using available data collected by neuroscientists and trying to fill in the gaps of knowledge. That is where simulation comes into play. People do not need to know every little detail about the brain to be able to simulate an accurate brain.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== How the Blue Brain Project Was Used in Case Study ===&lt;br /&gt;
The technology that came out of the Blue Brain Project was used many times in different case studies. For example in a case study led by Andras Ecker and Daniela Egas Santander, the researchers used a computer model of cortex that had a representation of real neurons, dendrites, and synapses. Then they added a calcium-based learning rule to watch how learning occurs in a large network of neurons. The researchers ended up learning that during learning, the synapses did not all change at the same time. Only the specific ones needed for learning changed. They showed that dendrites and the structure of the network work together to learn at a larger scale.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Downfalls of the Blue Brain Project ==&lt;br /&gt;
&lt;br /&gt;
=== Ethical Concerns ===&lt;br /&gt;
The Blue Brain Project was a massive effort that resulted in significant development and knowledge. However, with that, certain norms were sacrificed. For example, the carbon footprint from the project is a major issue. The computers and data used for the project generated notable carbon emissions. Therefore, while the research is progressing, the natural environment’s health is being overlooked. &lt;br /&gt;
Also, for the project, a lot of data had to be collected from animal brains to validate the digital models. While animal data is necessary to see whether the digital models are accurate, people raise concerns about the ethics of all animal experimentation. There has to be a line drawn between animal testing and scientific development. &lt;br /&gt;
Finally, people do not know a lot about consciousness and what results in a conscious brain. Therefore, there is always a risk that the simulated brains will result in consciousness. This can raise questions about how people should treat the digital models if they do have partial consciousness.&lt;br /&gt;
&lt;br /&gt;
=== Unanswered Questions ===&lt;br /&gt;
There are certain questions that the Blue Brain Project cannot answer yet. To start, the researchers were able to simulate the mouse brain, but to expand that knowledge to a human brain, people would need stronger computers. This technology is not yet available, making the journey to scaling up to a human brain extremely challenging. Additionally, the Blue Brain Project has a lot of data, yet people still do not know how to explain certain brain functions, such as thoughts, memory, and emotions. People cannot accurately pinpoint how neurons and synapses connect to achieve these higher-level brain functions.&lt;br /&gt;
&lt;br /&gt;
== Conclusion ==&lt;br /&gt;
The Blue Brain Project is an important step in neuroscience. Although there are still many mysteries about the brain, any step towards understanding is a crucial one. The mouse brain is a mammal brain, so although quite different, the mouse can be a step closer to understanding the human brain. One day, there will be enough knowledge, technology, and time to fully explain how the human brain functions. The Blue Brain Project will be a part of the history that helps people gain a deeper understanding.&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=770</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=770"/>
				<updated>2025-11-20T15:44:06Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further. &amp;lt;ref&amp;gt;‌Blue Brain Project. “Blue Brain Project.” EPFL,&lt;br /&gt;
[https://bluebrain.epfl.ch/bbp/research/domains/bluebrain/] &amp;lt;/ref&amp;gt;&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Parts of the Project ===&lt;br /&gt;
The project has many complicated parts that make it function. To begin, the project was considered finished when the following algorithms were complete. First, the volumes and dimensions of the brain had to be generated. Then the neurons had to be populated for each brain region. The cell types then had to be defined. Next, the dendrites, projections of a neuron that receive signals from other neurons, had to be computationally grown. Other parts of the brain, such as axons (parts of a neuron that transfer information from the cell body to other neurons) and synapses (where two neurons communicate with each other), had to be produced. Finally, the neurons, brain regions, and brain systems of the mouse brain had to be simulated on supercomputers. It is important to note that digital brains are not copies of the actual brain. Rather, they are representations of the brain. However, replicating the whole brain is extremely difficult, as the brain has so many parts. That’s why the researchers behind the Blue Brain project had to tackle the issue in multiple steps. The brain had to first be filled with neurons. Here is where the fact that they were replicating a mouse brain was essential. The human brain has about a thousand times more neurons than the mouse brain. So filling the digital brain with neurons for a mouse was easier than for a human. The next step was to actually grow the dendrites and axons. Then they had to find where to connect the dendrites and axons so they could put the synapses in the proper locations. The final step to get the digital brain to work like a real brain was to turn it on with specific electrical behavior. All of these steps were done by generalizing the available data about the brain. It would be extremely time-consuming to find all the possible data about the brain, so the Blue Brain Project took the information they had and generalized it to the brain as a whole.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Milestones ===&lt;br /&gt;
Throughout the process of creating this digital brain, the team faced many milestones that inspired them to keep going. For instance, the scientists were able to grow parts of the brain, such as dendrites, with mathematical models. Also, when connecting brain regions, the scientists were able to do so algorithmically. When the digital brain was created, the researchers were able to mimic actual biological experiments, which allowed them to conclude that their digital brain was viable. Therefore, all of the automations helped the project efficiently take form.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Can Help Society ==&lt;br /&gt;
The Blue Brain Project is a technological advancement that can be used in various ways to help people. Specifically, simulation neuroscience is a helpful tool to study the brain without having to use an actual, physical brain. This can then be used to study the brain’s diseases and how to best tackle them. Today, there exist virtual labs where users can explore parts of the brain. The hope is that in the future, people will be able to build and simulate brains for all species, genders, and ages. The Blue Brain Project is a step closer to simulating the brain for everyone.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic2.jpg|thumb|This image shows neural simulation in the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Why Simulate the Brain? ===&lt;br /&gt;
Simulating the brain is not the same as studying the brain, so why do researchers want to do it? The main reason is that the brain has too many parts. It would take a long time to map every part of the brain through experiments. The Blue Brain Project tackles this problem by using available data collected by neuroscientists and trying to fill in the gaps of knowledge. That is where simulation comes into play. People do not need to know every little detail about the brain to be able to simulate an accurate brain.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== How the Blue Brain Project Was Used in Case Study ===&lt;br /&gt;
The technology that came out of the Blue Brain Project was used many times in different case studies. For example in a case study led by Andras Ecker and Daniela Egas Santander, the researchers used a computer model of cortex that had a representation of real neurons, dendrites, and synapses. Then they added a calcium-based learning rule to watch how learning occurs in a large network of neurons. The researchers ended up learning that during learning, the synapses did not all change at the same time. Only the specific ones needed for learning changed. They showed that dendrites and the structure of the network work together to learn at a larger scale.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Downfalls of the Blue Brain Project ==&lt;br /&gt;
&lt;br /&gt;
=== Ethical Concerns ===&lt;br /&gt;
The Blue Brain Project was a massive effort that resulted in significant development and knowledge. However, with that, certain norms were sacrificed. For example, the carbon footprint from the project is a major issue. The computers and data used for the project generated notable carbon emissions. Therefore, while the research is progressing, the natural environment’s health is being overlooked. &lt;br /&gt;
Also, for the project, a lot of data had to be collected from animal brains to validate the digital models. While animal data is necessary to see whether the digital models are accurate, people raise concerns about the ethics of all animal experimentation. There has to be a line drawn between animal testing and scientific development. &lt;br /&gt;
Finally, people do not know a lot about consciousness and what results in a conscious brain. Therefore, there is always a risk that the simulated brains will result in consciousness. This can raise questions about how people should treat the digital models if they do have partial consciousness.&lt;br /&gt;
&lt;br /&gt;
=== Unanswered Questions ===&lt;br /&gt;
There are certain questions that the Blue Brain Project cannot answer yet. To start, the researchers were able to simulate the mouse brain, but to expand that knowledge to a human brain, people would need stronger computers. This technology is not yet available, making the journey to scaling up to a human brain extremely challenging. Additionally, the Blue Brain Project has a lot of data, yet people still do not know how to explain certain brain functions, such as thoughts, memory, and emotions. People cannot accurately pinpoint how neurons and synapses connect to achieve these higher-level brain functions.&lt;br /&gt;
&lt;br /&gt;
== Conclusion ==&lt;br /&gt;
The Blue Brain Project is an important step in neuroscience. Although there are still many mysteries about the brain, any step towards understanding is a crucial one. The mouse brain is a mammal brain, so although quite different, the mouse can be a step closer to understanding the human brain. One day, there will be enough knowledge, technology, and time to fully explain how the human brain functions. The Blue Brain Project will be a part of the history that helps people gain a deeper understanding.&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=769</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=769"/>
				<updated>2025-11-20T15:43:29Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further. &amp;lt;ref&amp;gt;‌Blue Brain Project. “Blue Brain Project.” EPFL,&lt;br /&gt;
bluebrain.epfl.ch/bbp/research/domains/bluebrain/ &amp;lt;/ref&amp;gt;&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Parts of the Project ===&lt;br /&gt;
The project has many complicated parts that make it function. To begin, the project was considered finished when the following algorithms were complete. First, the volumes and dimensions of the brain had to be generated. Then the neurons had to be populated for each brain region. The cell types then had to be defined. Next, the dendrites, projections of a neuron that receive signals from other neurons, had to be computationally grown. Other parts of the brain, such as axons (parts of a neuron that transfer information from the cell body to other neurons) and synapses (where two neurons communicate with each other), had to be produced. Finally, the neurons, brain regions, and brain systems of the mouse brain had to be simulated on supercomputers. It is important to note that digital brains are not copies of the actual brain. Rather, they are representations of the brain. However, replicating the whole brain is extremely difficult, as the brain has so many parts. That’s why the researchers behind the Blue Brain project had to tackle the issue in multiple steps. The brain had to first be filled with neurons. Here is where the fact that they were replicating a mouse brain was essential. The human brain has about a thousand times more neurons than the mouse brain. So filling the digital brain with neurons for a mouse was easier than for a human. The next step was to actually grow the dendrites and axons. Then they had to find where to connect the dendrites and axons so they could put the synapses in the proper locations. The final step to get the digital brain to work like a real brain was to turn it on with specific electrical behavior. All of these steps were done by generalizing the available data about the brain. It would be extremely time-consuming to find all the possible data about the brain, so the Blue Brain Project took the information they had and generalized it to the brain as a whole.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Milestones ===&lt;br /&gt;
Throughout the process of creating this digital brain, the team faced many milestones that inspired them to keep going. For instance, the scientists were able to grow parts of the brain, such as dendrites, with mathematical models. Also, when connecting brain regions, the scientists were able to do so algorithmically. When the digital brain was created, the researchers were able to mimic actual biological experiments, which allowed them to conclude that their digital brain was viable. Therefore, all of the automations helped the project efficiently take form.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Can Help Society ==&lt;br /&gt;
The Blue Brain Project is a technological advancement that can be used in various ways to help people. Specifically, simulation neuroscience is a helpful tool to study the brain without having to use an actual, physical brain. This can then be used to study the brain’s diseases and how to best tackle them. Today, there exist virtual labs where users can explore parts of the brain. The hope is that in the future, people will be able to build and simulate brains for all species, genders, and ages. The Blue Brain Project is a step closer to simulating the brain for everyone.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic2.jpg|thumb|This image shows neural simulation in the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Why Simulate the Brain? ===&lt;br /&gt;
Simulating the brain is not the same as studying the brain, so why do researchers want to do it? The main reason is that the brain has too many parts. It would take a long time to map every part of the brain through experiments. The Blue Brain Project tackles this problem by using available data collected by neuroscientists and trying to fill in the gaps of knowledge. That is where simulation comes into play. People do not need to know every little detail about the brain to be able to simulate an accurate brain.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== How the Blue Brain Project Was Used in Case Study ===&lt;br /&gt;
The technology that came out of the Blue Brain Project was used many times in different case studies. For example in a case study led by Andras Ecker and Daniela Egas Santander, the researchers used a computer model of cortex that had a representation of real neurons, dendrites, and synapses. Then they added a calcium-based learning rule to watch how learning occurs in a large network of neurons. The researchers ended up learning that during learning, the synapses did not all change at the same time. Only the specific ones needed for learning changed. They showed that dendrites and the structure of the network work together to learn at a larger scale.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Downfalls of the Blue Brain Project ==&lt;br /&gt;
&lt;br /&gt;
=== Ethical Concerns ===&lt;br /&gt;
The Blue Brain Project was a massive effort that resulted in significant development and knowledge. However, with that, certain norms were sacrificed. For example, the carbon footprint from the project is a major issue. The computers and data used for the project generated notable carbon emissions. Therefore, while the research is progressing, the natural environment’s health is being overlooked. &lt;br /&gt;
Also, for the project, a lot of data had to be collected from animal brains to validate the digital models. While animal data is necessary to see whether the digital models are accurate, people raise concerns about the ethics of all animal experimentation. There has to be a line drawn between animal testing and scientific development. &lt;br /&gt;
Finally, people do not know a lot about consciousness and what results in a conscious brain. Therefore, there is always a risk that the simulated brains will result in consciousness. This can raise questions about how people should treat the digital models if they do have partial consciousness.&lt;br /&gt;
&lt;br /&gt;
=== Unanswered Questions ===&lt;br /&gt;
There are certain questions that the Blue Brain Project cannot answer yet. To start, the researchers were able to simulate the mouse brain, but to expand that knowledge to a human brain, people would need stronger computers. This technology is not yet available, making the journey to scaling up to a human brain extremely challenging. Additionally, the Blue Brain Project has a lot of data, yet people still do not know how to explain certain brain functions, such as thoughts, memory, and emotions. People cannot accurately pinpoint how neurons and synapses connect to achieve these higher-level brain functions.&lt;br /&gt;
&lt;br /&gt;
== Conclusion ==&lt;br /&gt;
The Blue Brain Project is an important step in neuroscience. Although there are still many mysteries about the brain, any step towards understanding is a crucial one. The mouse brain is a mammal brain, so although quite different, the mouse can be a step closer to understanding the human brain. One day, there will be enough knowledge, technology, and time to fully explain how the human brain functions. The Blue Brain Project will be a part of the history that helps people gain a deeper understanding.&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=768</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=768"/>
				<updated>2025-11-20T15:42:42Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further. &amp;lt;ref&amp;gt;Blue Brain Project, &amp;quot;Blue Brain Project&amp;quot;, 2024.&amp;lt;/ref&amp;gt;&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Parts of the Project ===&lt;br /&gt;
The project has many complicated parts that make it function. To begin, the project was considered finished when the following algorithms were complete. First, the volumes and dimensions of the brain had to be generated. Then the neurons had to be populated for each brain region. The cell types then had to be defined. Next, the dendrites, projections of a neuron that receive signals from other neurons, had to be computationally grown. Other parts of the brain, such as axons (parts of a neuron that transfer information from the cell body to other neurons) and synapses (where two neurons communicate with each other), had to be produced. Finally, the neurons, brain regions, and brain systems of the mouse brain had to be simulated on supercomputers. It is important to note that digital brains are not copies of the actual brain. Rather, they are representations of the brain. However, replicating the whole brain is extremely difficult, as the brain has so many parts. That’s why the researchers behind the Blue Brain project had to tackle the issue in multiple steps. The brain had to first be filled with neurons. Here is where the fact that they were replicating a mouse brain was essential. The human brain has about a thousand times more neurons than the mouse brain. So filling the digital brain with neurons for a mouse was easier than for a human. The next step was to actually grow the dendrites and axons. Then they had to find where to connect the dendrites and axons so they could put the synapses in the proper locations. The final step to get the digital brain to work like a real brain was to turn it on with specific electrical behavior. All of these steps were done by generalizing the available data about the brain. It would be extremely time-consuming to find all the possible data about the brain, so the Blue Brain Project took the information they had and generalized it to the brain as a whole.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Milestones ===&lt;br /&gt;
Throughout the process of creating this digital brain, the team faced many milestones that inspired them to keep going. For instance, the scientists were able to grow parts of the brain, such as dendrites, with mathematical models. Also, when connecting brain regions, the scientists were able to do so algorithmically. When the digital brain was created, the researchers were able to mimic actual biological experiments, which allowed them to conclude that their digital brain was viable. Therefore, all of the automations helped the project efficiently take form.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Can Help Society ==&lt;br /&gt;
The Blue Brain Project is a technological advancement that can be used in various ways to help people. Specifically, simulation neuroscience is a helpful tool to study the brain without having to use an actual, physical brain. This can then be used to study the brain’s diseases and how to best tackle them. Today, there exist virtual labs where users can explore parts of the brain. The hope is that in the future, people will be able to build and simulate brains for all species, genders, and ages. The Blue Brain Project is a step closer to simulating the brain for everyone.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic2.jpg|thumb|This image shows neural simulation in the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Why Simulate the Brain? ===&lt;br /&gt;
Simulating the brain is not the same as studying the brain, so why do researchers want to do it? The main reason is that the brain has too many parts. It would take a long time to map every part of the brain through experiments. The Blue Brain Project tackles this problem by using available data collected by neuroscientists and trying to fill in the gaps of knowledge. That is where simulation comes into play. People do not need to know every little detail about the brain to be able to simulate an accurate brain.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== How the Blue Brain Project Was Used in Case Study ===&lt;br /&gt;
The technology that came out of the Blue Brain Project was used many times in different case studies. For example in a case study led by Andras Ecker and Daniela Egas Santander, the researchers used a computer model of cortex that had a representation of real neurons, dendrites, and synapses. Then they added a calcium-based learning rule to watch how learning occurs in a large network of neurons. The researchers ended up learning that during learning, the synapses did not all change at the same time. Only the specific ones needed for learning changed. They showed that dendrites and the structure of the network work together to learn at a larger scale.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Downfalls of the Blue Brain Project ==&lt;br /&gt;
&lt;br /&gt;
=== Ethical Concerns ===&lt;br /&gt;
The Blue Brain Project was a massive effort that resulted in significant development and knowledge. However, with that, certain norms were sacrificed. For example, the carbon footprint from the project is a major issue. The computers and data used for the project generated notable carbon emissions. Therefore, while the research is progressing, the natural environment’s health is being overlooked. &lt;br /&gt;
Also, for the project, a lot of data had to be collected from animal brains to validate the digital models. While animal data is necessary to see whether the digital models are accurate, people raise concerns about the ethics of all animal experimentation. There has to be a line drawn between animal testing and scientific development. &lt;br /&gt;
Finally, people do not know a lot about consciousness and what results in a conscious brain. Therefore, there is always a risk that the simulated brains will result in consciousness. This can raise questions about how people should treat the digital models if they do have partial consciousness.&lt;br /&gt;
&lt;br /&gt;
=== Unanswered Questions ===&lt;br /&gt;
There are certain questions that the Blue Brain Project cannot answer yet. To start, the researchers were able to simulate the mouse brain, but to expand that knowledge to a human brain, people would need stronger computers. This technology is not yet available, making the journey to scaling up to a human brain extremely challenging. Additionally, the Blue Brain Project has a lot of data, yet people still do not know how to explain certain brain functions, such as thoughts, memory, and emotions. People cannot accurately pinpoint how neurons and synapses connect to achieve these higher-level brain functions.&lt;br /&gt;
&lt;br /&gt;
== Conclusion ==&lt;br /&gt;
The Blue Brain Project is an important step in neuroscience. Although there are still many mysteries about the brain, any step towards understanding is a crucial one. The mouse brain is a mammal brain, so although quite different, the mouse can be a step closer to understanding the human brain. One day, there will be enough knowledge, technology, and time to fully explain how the human brain functions. The Blue Brain Project will be a part of the history that helps people gain a deeper understanding.&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=767</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=767"/>
				<updated>2025-11-20T15:33:42Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further. [https://bluebrain.epfl.ch/bbp/research/domains/bluebrain/]&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Parts of the Project ===&lt;br /&gt;
The project has many complicated parts that make it function. To begin, the project was considered finished when the following algorithms were complete. First, the volumes and dimensions of the brain had to be generated. Then the neurons had to be populated for each brain region. The cell types then had to be defined. Next, the dendrites, projections of a neuron that receive signals from other neurons, had to be computationally grown. Other parts of the brain, such as axons (parts of a neuron that transfer information from the cell body to other neurons) and synapses (where two neurons communicate with each other), had to be produced. Finally, the neurons, brain regions, and brain systems of the mouse brain had to be simulated on supercomputers. It is important to note that digital brains are not copies of the actual brain. Rather, they are representations of the brain. However, replicating the whole brain is extremely difficult, as the brain has so many parts. That’s why the researchers behind the Blue Brain project had to tackle the issue in multiple steps. The brain had to first be filled with neurons. Here is where the fact that they were replicating a mouse brain was essential. The human brain has about a thousand times more neurons than the mouse brain. So filling the digital brain with neurons for a mouse was easier than for a human. The next step was to actually grow the dendrites and axons. Then they had to find where to connect the dendrites and axons so they could put the synapses in the proper locations. The final step to get the digital brain to work like a real brain was to turn it on with specific electrical behavior. All of these steps were done by generalizing the available data about the brain. It would be extremely time-consuming to find all the possible data about the brain, so the Blue Brain Project took the information they had and generalized it to the brain as a whole.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Milestones ===&lt;br /&gt;
Throughout the process of creating this digital brain, the team faced many milestones that inspired them to keep going. For instance, the scientists were able to grow parts of the brain, such as dendrites, with mathematical models. Also, when connecting brain regions, the scientists were able to do so algorithmically. When the digital brain was created, the researchers were able to mimic actual biological experiments, which allowed them to conclude that their digital brain was viable. Therefore, all of the automations helped the project efficiently take form.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Can Help Society ==&lt;br /&gt;
The Blue Brain Project is a technological advancement that can be used in various ways to help people. Specifically, simulation neuroscience is a helpful tool to study the brain without having to use an actual, physical brain. This can then be used to study the brain’s diseases and how to best tackle them. Today, there exist virtual labs where users can explore parts of the brain. The hope is that in the future, people will be able to build and simulate brains for all species, genders, and ages. The Blue Brain Project is a step closer to simulating the brain for everyone.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic2.jpg|thumb|This image shows neural simulation in the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Why Simulate the Brain? ===&lt;br /&gt;
Simulating the brain is not the same as studying the brain, so why do researchers want to do it? The main reason is that the brain has too many parts. It would take a long time to map every part of the brain through experiments. The Blue Brain Project tackles this problem by using available data collected by neuroscientists and trying to fill in the gaps of knowledge. That is where simulation comes into play. People do not need to know every little detail about the brain to be able to simulate an accurate brain.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== How the Blue Brain Project Was Used in Case Study ===&lt;br /&gt;
The technology that came out of the Blue Brain Project was used many times in different case studies. For example in a case study led by Andras Ecker and Daniela Egas Santander, the researchers used a computer model of cortex that had a representation of real neurons, dendrites, and synapses. Then they added a calcium-based learning rule to watch how learning occurs in a large network of neurons. The researchers ended up learning that during learning, the synapses did not all change at the same time. Only the specific ones needed for learning changed. They showed that dendrites and the structure of the network work together to learn at a larger scale.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Downfalls of the Blue Brain Project ==&lt;br /&gt;
&lt;br /&gt;
=== Ethical Concerns ===&lt;br /&gt;
The Blue Brain Project was a massive effort that resulted in significant development and knowledge. However, with that, certain norms were sacrificed. For example, the carbon footprint from the project is a major issue. The computers and data used for the project generated notable carbon emissions. Therefore, while the research is progressing, the natural environment’s health is being overlooked. &lt;br /&gt;
Also, for the project, a lot of data had to be collected from animal brains to validate the digital models. While animal data is necessary to see whether the digital models are accurate, people raise concerns about the ethics of all animal experimentation. There has to be a line drawn between animal testing and scientific development. &lt;br /&gt;
Finally, people do not know a lot about consciousness and what results in a conscious brain. Therefore, there is always a risk that the simulated brains will result in consciousness. This can raise questions about how people should treat the digital models if they do have partial consciousness.&lt;br /&gt;
&lt;br /&gt;
=== Unanswered Questions ===&lt;br /&gt;
There are certain questions that the Blue Brain Project cannot answer yet. To start, the researchers were able to simulate the mouse brain, but to expand that knowledge to a human brain, people would need stronger computers. This technology is not yet available, making the journey to scaling up to a human brain extremely challenging. Additionally, the Blue Brain Project has a lot of data, yet people still do not know how to explain certain brain functions, such as thoughts, memory, and emotions. People cannot accurately pinpoint how neurons and synapses connect to achieve these higher-level brain functions.&lt;br /&gt;
&lt;br /&gt;
== Conclusion ==&lt;br /&gt;
The Blue Brain Project is an important step in neuroscience. Although there are still many mysteries about the brain, any step towards understanding is a crucial one. The mouse brain is a mammal brain, so although quite different, the mouse can be a step closer to understanding the human brain. One day, there will be enough knowledge, technology, and time to fully explain how the human brain functions. The Blue Brain Project will be a part of the history that helps people gain a deeper understanding.&lt;br /&gt;
&lt;br /&gt;
==References==&lt;br /&gt;
{{reflist}}&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=766</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=766"/>
				<updated>2025-11-20T15:27:38Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further. [https://bluebrain.epfl.ch/bbp/research/domains/bluebrain/]&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Parts of the Project ===&lt;br /&gt;
The project has many complicated parts that make it function. To begin, the project was considered finished when the following algorithms were complete. First, the volumes and dimensions of the brain had to be generated. Then the neurons had to be populated for each brain region. The cell types then had to be defined. Next, the dendrites, projections of a neuron that receive signals from other neurons, had to be computationally grown. Other parts of the brain, such as axons (parts of a neuron that transfer information from the cell body to other neurons) and synapses (where two neurons communicate with each other), had to be produced. Finally, the neurons, brain regions, and brain systems of the mouse brain had to be simulated on supercomputers. It is important to note that digital brains are not copies of the actual brain. Rather, they are representations of the brain. However, replicating the whole brain is extremely difficult, as the brain has so many parts. That’s why the researchers behind the Blue Brain project had to tackle the issue in multiple steps. The brain had to first be filled with neurons. Here is where the fact that they were replicating a mouse brain was essential. The human brain has about a thousand times more neurons than the mouse brain. So filling the digital brain with neurons for a mouse was easier than for a human. The next step was to actually grow the dendrites and axons. Then they had to find where to connect the dendrites and axons so they could put the synapses in the proper locations. The final step to get the digital brain to work like a real brain was to turn it on with specific electrical behavior. All of these steps were done by generalizing the available data about the brain. It would be extremely time-consuming to find all the possible data about the brain, so the Blue Brain Project took the information they had and generalized it to the brain as a whole.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Milestones ===&lt;br /&gt;
Throughout the process of creating this digital brain, the team faced many milestones that inspired them to keep going. For instance, the scientists were able to grow parts of the brain, such as dendrites, with mathematical models. Also, when connecting brain regions, the scientists were able to do so algorithmically. When the digital brain was created, the researchers were able to mimic actual biological experiments, which allowed them to conclude that their digital brain was viable. Therefore, all of the automations helped the project efficiently take form.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Can Help Society ==&lt;br /&gt;
The Blue Brain Project is a technological advancement that can be used in various ways to help people. Specifically, simulation neuroscience is a helpful tool to study the brain without having to use an actual, physical brain. This can then be used to study the brain’s diseases and how to best tackle them. Today, there exist virtual labs where users can explore parts of the brain. The hope is that in the future, people will be able to build and simulate brains for all species, genders, and ages. The Blue Brain Project is a step closer to simulating the brain for everyone.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic2.jpg|thumb|This image shows neural simulation in the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Why Simulate the Brain? ===&lt;br /&gt;
Simulating the brain is not the same as studying the brain, so why do researchers want to do it? The main reason is that the brain has too many parts. It would take a long time to map every part of the brain through experiments. The Blue Brain Project tackles this problem by using available data collected by neuroscientists and trying to fill in the gaps of knowledge. That is where simulation comes into play. People do not need to know every little detail about the brain to be able to simulate an accurate brain.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== How the Blue Brain Project Was Used in Case Study ===&lt;br /&gt;
The technology that came out of the Blue Brain Project was used many times in different case studies. For example in a case study led by Andras Ecker and Daniela Egas Santander, the researchers used a computer model of cortex that had a representation of real neurons, dendrites, and synapses. Then they added a calcium-based learning rule to watch how learning occurs in a large network of neurons. The researchers ended up learning that during learning, the synapses did not all change at the same time. Only the specific ones needed for learning changed. They showed that dendrites and the structure of the network work together to learn at a larger scale.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Downfalls of the Blue Brain Project ==&lt;br /&gt;
&lt;br /&gt;
=== Ethical Concerns ===&lt;br /&gt;
The Blue Brain Project was a massive effort that resulted in significant development and knowledge. However, with that, certain norms were sacrificed. For example, the carbon footprint from the project is a major issue. The computers and data used for the project generated notable carbon emissions. Therefore, while the research is progressing, the natural environment’s health is being overlooked. &lt;br /&gt;
Also, for the project, a lot of data had to be collected from animal brains to validate the digital models. While animal data is necessary to see whether the digital models are accurate, people raise concerns about the ethics of all animal experimentation. There has to be a line drawn between animal testing and scientific development. &lt;br /&gt;
Finally, people do not know a lot about consciousness and what results in a conscious brain. Therefore, there is always a risk that the simulated brains will result in consciousness. This can raise questions about how people should treat the digital models if they do have partial consciousness.&lt;br /&gt;
&lt;br /&gt;
=== Unanswered Questions ===&lt;br /&gt;
There are certain questions that the Blue Brain Project cannot answer yet. To start, the researchers were able to simulate the mouse brain, but to expand that knowledge to a human brain, people would need stronger computers. This technology is not yet available, making the journey to scaling up to a human brain extremely challenging. Additionally, the Blue Brain Project has a lot of data, yet people still do not know how to explain certain brain functions, such as thoughts, memory, and emotions. People cannot accurately pinpoint how neurons and synapses connect to achieve these higher-level brain functions.&lt;br /&gt;
&lt;br /&gt;
== Conclusion ==&lt;br /&gt;
The Blue Brain Project is an important step in neuroscience. Although there are still many mysteries about the brain, any step towards understanding is a crucial one. The mouse brain is a mammal brain, so although quite different, the mouse can be a step closer to understanding the human brain. One day, there will be enough knowledge, technology, and time to fully explain how the human brain functions. The Blue Brain Project will be a part of the history that helps people gain a deeper understanding.&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=765</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=765"/>
				<updated>2025-11-20T15:17:48Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Parts of the Project ===&lt;br /&gt;
The project has many complicated parts that make it function. To begin, the project was considered finished when the following algorithms were complete. First, the volumes and dimensions of the brain had to be generated. Then the neurons had to be populated for each brain region. The cell types then had to be defined. Next, the dendrites, projections of a neuron that receive signals from other neurons, had to be computationally grown. Other parts of the brain, such as axons (parts of a neuron that transfer information from the cell body to other neurons) and synapses (where two neurons communicate with each other), had to be produced. Finally, the neurons, brain regions, and brain systems of the mouse brain had to be simulated on supercomputers. It is important to note that digital brains are not copies of the actual brain. Rather, they are representations of the brain. However, replicating the whole brain is extremely difficult, as the brain has so many parts. That’s why the researchers behind the Blue Brain project had to tackle the issue in multiple steps. The brain had to first be filled with neurons. Here is where the fact that they were replicating a mouse brain was essential. The human brain has about a thousand times more neurons than the mouse brain. So filling the digital brain with neurons for a mouse was easier than for a human. The next step was to actually grow the dendrites and axons. Then they had to find where to connect the dendrites and axons so they could put the synapses in the proper locations. The final step to get the digital brain to work like a real brain was to turn it on with specific electrical behavior. All of these steps were done by generalizing the available data about the brain. It would be extremely time-consuming to find all the possible data about the brain, so the Blue Brain Project took the information they had and generalized it to the brain as a whole.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Milestones ===&lt;br /&gt;
Throughout the process of creating this digital brain, the team faced many milestones that inspired them to keep going. For instance, the scientists were able to grow parts of the brain, such as dendrites, with mathematical models. Also, when connecting brain regions, the scientists were able to do so algorithmically. When the digital brain was created, the researchers were able to mimic actual biological experiments, which allowed them to conclude that their digital brain was viable. Therefore, all of the automations helped the project efficiently take form.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Can Help Society ==&lt;br /&gt;
The Blue Brain Project is a technological advancement that can be used in various ways to help people. Specifically, simulation neuroscience is a helpful tool to study the brain without having to use an actual, physical brain. This can then be used to study the brain’s diseases and how to best tackle them. Today, there exist virtual labs where users can explore parts of the brain. The hope is that in the future, people will be able to build and simulate brains for all species, genders, and ages. The Blue Brain Project is a step closer to simulating the brain for everyone.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic2.jpg|thumb|This image shows neural simulation in the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Why Simulate the Brain? ===&lt;br /&gt;
Simulating the brain is not the same as studying the brain, so why do researchers want to do it? The main reason is that the brain has too many parts. It would take a long time to map every part of the brain through experiments. The Blue Brain Project tackles this problem by using available data collected by neuroscientists and trying to fill in the gaps of knowledge. That is where simulation comes into play. People do not need to know every little detail about the brain to be able to simulate an accurate brain.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== How the Blue Brain Project Was Used in Case Study ===&lt;br /&gt;
The technology that came out of the Blue Brain Project was used many times in different case studies. For example in a case study led by Andras Ecker and Daniela Egas Santander, the researchers used a computer model of cortex that had a representation of real neurons, dendrites, and synapses. Then they added a calcium-based learning rule to watch how learning occurs in a large network of neurons. The researchers ended up learning that during learning, the synapses did not all change at the same time. Only the specific ones needed for learning changed. They showed that dendrites and the structure of the network work together to learn at a larger scale.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Downfalls of the Blue Brain Project ==&lt;br /&gt;
&lt;br /&gt;
=== Ethical Concerns ===&lt;br /&gt;
The Blue Brain Project was a massive effort that resulted in significant development and knowledge. However, with that, certain norms were sacrificed. For example, the carbon footprint from the project is a major issue. The computers and data used for the project generated notable carbon emissions. Therefore, while the research is progressing, the natural environment’s health is being overlooked. &lt;br /&gt;
Also, for the project, a lot of data had to be collected from animal brains to validate the digital models. While animal data is necessary to see whether the digital models are accurate, people raise concerns about the ethics of all animal experimentation. There has to be a line drawn between animal testing and scientific development. &lt;br /&gt;
Finally, people do not know a lot about consciousness and what results in a conscious brain. Therefore, there is always a risk that the simulated brains will result in consciousness. This can raise questions about how people should treat the digital models if they do have partial consciousness.&lt;br /&gt;
&lt;br /&gt;
=== Unanswered Questions ===&lt;br /&gt;
There are certain questions that the Blue Brain Project cannot answer yet. To start, the researchers were able to simulate the mouse brain, but to expand that knowledge to a human brain, people would need stronger computers. This technology is not yet available, making the journey to scaling up to a human brain extremely challenging. Additionally, the Blue Brain Project has a lot of data, yet people still do not know how to explain certain brain functions, such as thoughts, memory, and emotions. People cannot accurately pinpoint how neurons and synapses connect to achieve these higher-level brain functions.&lt;br /&gt;
&lt;br /&gt;
== Conclusion ==&lt;br /&gt;
The Blue Brain Project is an important step in neuroscience. Although there are still many mysteries about the brain, any step towards understanding is a crucial one. The mouse brain is a mammal brain, so although quite different, the mouse can be a step closer to understanding the human brain. One day, there will be enough knowledge, technology, and time to fully explain how the human brain functions. The Blue Brain Project will be a part of the history that helps people gain a deeper understanding.&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=764</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=764"/>
				<updated>2025-11-20T15:14:57Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* About the Project */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Parts of the Project ==&lt;br /&gt;
The project has many complicated parts that make it function. To begin, the project was considered finished when the following algorithms were complete. First, the volumes and dimensions of the brain had to be generated. Then the neurons had to be populated for each brain region. The cell types then had to be defined. Next, the dendrites, projections of a neuron that receive signals from other neurons, had to be computationally grown. Other parts of the brain, such as axons (parts of a neuron that transfer information from the cell body to other neurons) and synapses (where two neurons communicate with each other), had to be produced. Finally, the neurons, brain regions, and brain systems of the mouse brain had to be simulated on supercomputers. It is important to note that digital brains are not copies of the actual brain. Rather, they are representations of the brain. However, replicating the whole brain is extremely difficult, as the brain has so many parts. That’s why the researchers behind the Blue Brain project had to tackle the issue in multiple steps. The brain had to first be filled with neurons. Here is where the fact that they were replicating a mouse brain was essential. The human brain has about a thousand times more neurons than the mouse brain. So filling the digital brain with neurons for a mouse was easier than for a human. The next step was to actually grow the dendrites and axons. Then they had to find where to connect the dendrites and axons so they could put the synapses in the proper locations. The final step to get the digital brain to work like a real brain was to turn it on with specific electrical behavior. All of these steps were done by generalizing the available data about the brain. It would be extremely time-consuming to find all the possible data about the brain, so the Blue Brain Project took the information they had and generalized it to the brain as a whole.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Milestones ==&lt;br /&gt;
Throughout the process of creating this digital brain, the team faced many milestones that inspired them to keep going. For instance, the scientists were able to grow parts of the brain, such as dendrites, with mathematical models. Also, when connecting brain regions, the scientists were able to do so algorithmically. When the digital brain was created, the researchers were able to mimic actual biological experiments, which allowed them to conclude that their digital brain was viable. Therefore, all of the automations helped the project efficiently take form.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Can Help Society ==&lt;br /&gt;
The Blue Brain Project is a technological advancement that can be used in various ways to help people. Specifically, simulation neuroscience is a helpful tool to study the brain without having to use an actual, physical brain. This can then be used to study the brain’s diseases and how to best tackle them. Today, there exist virtual labs where users can explore parts of the brain. The hope is that in the future, people will be able to build and simulate brains for all species, genders, and ages. The Blue Brain Project is a step closer to simulating the brain for everyone.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic2|thumb|This image shows neural simulation in the digital brain.]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Why Simulate the Brain? ==&lt;br /&gt;
Simulating the brain is not the same as studying the brain, so why do researchers want to do it? The main reason is that the brain has too many parts. It would take a long time to map every part of the brain through experiments. The Blue Brain Project tackles this problem by using available data collected by neuroscientists and trying to fill in the gaps of knowledge. That is where simulation comes into play. People do not need to know every little detail about the brain to be able to simulate an accurate brain.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How the Blue Brain Project Was Used in Case Study ==&lt;br /&gt;
The technology that came out of the Blue Brain Project was used many times in different case studies. For example in a case study led by Andras Ecker and Daniela Egas Santander, the researchers used a computer model of cortex that had a representation of real neurons, dendrites, and synapses. Then they added a calcium-based learning rule to watch how learning occurs in a large network of neurons. The researchers ended up learning that during learning, the synapses did not all change at the same time. Only the specific ones needed for learning changed. They showed that dendrites and the structure of the network work together to learn at a larger scale.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Downfalls of the Blue Brain Project ==&lt;br /&gt;
&lt;br /&gt;
=== Ethical Concerns ===&lt;br /&gt;
The Blue Brain Project was a massive effort that resulted in significant development and knowledge. However, with that, certain norms were sacrificed. For example, the carbon footprint from the project is a major issue. The computers and data used for the project generated notable carbon emissions. Therefore, while the research is progressing, the natural environment’s health is being overlooked. &lt;br /&gt;
Also, for the project, a lot of data had to be collected from animal brains to validate the digital models. While animal data is necessary to see whether the digital models are accurate, people raise concerns about the ethics of all animal experimentation. There has to be a line drawn between animal testing and scientific development. &lt;br /&gt;
Finally, people do not know a lot about consciousness and what results in a conscious brain. Therefore, there is always a risk that the simulated brains will result in consciousness. This can raise questions about how people should treat the digital models if they do have partial consciousness.&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=763</id>
		<title>Blue Brain Project By: Sasha Bryukhova</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Blue_Brain_Project_By:_Sasha_Bryukhova&amp;diff=763"/>
				<updated>2025-11-20T15:11:36Z</updated>
		
		<summary type="html">&lt;p&gt;User: Created page with &amp;quot;By: Sasha Bryukhova   == About the Project == The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted fro...&amp;quot;&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;By: Sasha Bryukhova&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the Project ==&lt;br /&gt;
The Blue Brain Project was a research initiative focused on establishing a simulation-based neuroscience approach that lasted from 2005 to 2024. Led and directed by Professor Henry Markram, the Blue Brain Project wanted to find an approach to understand the brain alongside experimental, theoretical, and clinical neuroscience. Although far from the end, this project was a major development in neuroscience as it built the world's first biologically detailed reconstruction of the mouse brain. This is influential because although the mouse brain is not the same as a human brain, they are both mammal brains. Once one is understood, steps can be made to understand the other further.&lt;br /&gt;
&lt;br /&gt;
[[File:BBP_pic1.jpg|thumb|A visual of the digital brain.]]&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=File:BBP_pic2.jpg&amp;diff=762</id>
		<title>File:BBP pic2.jpg</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=File:BBP_pic2.jpg&amp;diff=762"/>
				<updated>2025-11-20T15:09:20Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=File:BBP_pic1.jpg&amp;diff=761</id>
		<title>File:BBP pic1.jpg</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=File:BBP_pic1.jpg&amp;diff=761"/>
				<updated>2025-11-20T15:06:04Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Differential_Diagnosis_%26_Marr%E2%80%99s_3_Levels,_as_a_Paradigm_for_Integrating_Literatures&amp;diff=753</id>
		<title>Differential Diagnosis &amp; Marr’s 3 Levels, as a Paradigm for Integrating Literatures</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Differential_Diagnosis_%26_Marr%E2%80%99s_3_Levels,_as_a_Paradigm_for_Integrating_Literatures&amp;diff=753"/>
				<updated>2022-10-22T11:32:12Z</updated>
		
		<summary type="html">&lt;p&gt;User: User moved page Schema Theory of Memory to Differential Diagnosis &amp;amp; Marr’s 3 Levels, as a Paradigm for Integrating Literatures&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;''By Luke Hafermann''&lt;br /&gt;
&lt;br /&gt;
Memory schemas are a theorization of how the brain stores knowledge. This article provides an introduction to memory schemas, describing their structural attributes and the functionality these attributes give rise to. It also outlines a theorization paradigm for refining the concept of the schema, drawing specifically upon [https://en.wikipedia.org/wiki/David_Marr_(neuroscientist)#Levels_of_analysis Marr's 3 levels of analysis], and more generally upon the philosophies of mathematical and computational modeling.&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Schema_Theory_of_Memory&amp;diff=754</id>
		<title>Schema Theory of Memory</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Schema_Theory_of_Memory&amp;diff=754"/>
				<updated>2022-10-22T11:32:12Z</updated>
		
		<summary type="html">&lt;p&gt;User: User moved page Schema Theory of Memory to Differential Diagnosis &amp;amp; Marr’s 3 Levels, as a Paradigm for Integrating Literatures&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;#REDIRECT [[Differential Diagnosis &amp;amp; Marr’s 3 Levels, as a Paradigm for Integrating Literatures]]&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Differential_Diagnosis_%26_Marr%E2%80%99s_3_Levels,_as_a_Paradigm_for_Integrating_Literatures&amp;diff=755</id>
		<title>Differential Diagnosis &amp; Marr’s 3 Levels, as a Paradigm for Integrating Literatures</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Differential_Diagnosis_%26_Marr%E2%80%99s_3_Levels,_as_a_Paradigm_for_Integrating_Literatures&amp;diff=755"/>
				<updated>2022-10-22T11:32:12Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;''By Luke Hafermann''&lt;br /&gt;
&lt;br /&gt;
This article doubles as a section of my QSS thesis, on designing an ADHD test for rapid episodic visualization-- I was trying to draw together a lit review across some rather-incongruent terminologies used by the memory literature &amp;amp; the attention-literature, and finally realized I'd have to modify some of the existing terms, since none of the existing terms captured the necessary distinctions. This sections follows a little section called &amp;quot;Justification for Proposing New Terms&amp;quot;, which hopefully means the reader’s now on board with me synthesizing some new terminology, since I’ve assured them I’m handling carefully their established terminology-efforts.&lt;br /&gt;
&lt;br /&gt;
==Differential Diagnosis==&lt;br /&gt;
&lt;br /&gt;
In medicine, using the wrong terminology to describe a patient’s symptom-pattern is dangerous, so practitioners are cautious about assuming that the current diagnosis is correct. *Differential Diagnosis,* as a paradigm, includes engrained methods for differentiating between two diagnoses (or integrating components of two diagnoses) in order to better explain a patient’s symptom-pattern. Differential Diagnosis, with its focus on the patient’s well-being, attempts to avoid undue bias toward one diagnosis (set of terms) over another.&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis inspires this paper’s approach toward integrating the attention and memory literature, since it provides a neutral process for creating consistent terminology without favoring one literature over another. It includes guidance on 1) what to do with duplicate terms &amp;amp; 2) what to do with a term that (while important within one literature) fails to capture an important distinction made by the other literature. &lt;br /&gt;
&lt;br /&gt;
These 2 considerations are first illustrated within a relatively straightforward scenario, involving Differential Diagnosis of ADHD-like-symptoms, when no further integration is needed. Here, the patient’s physician can draw upon a hypothetical, neatly-integrated theory of ADHD which documents 2 potential causes of this symptom pattern. Diagnosis then involves a relatively straightforward process of identifying the subset of causes present for this particular patient (either both, either, or none), and reflects the value of a well-integrated theory where the causes are modular, non-overlapping, and mutually compatible. It is not even clear in this context why a “duplicate term” would arise, &amp;amp; each term easily incorporates additional distinctions as necessary (without compromising its use in other contexts). This straightforward scenario illustrates an ideal where there is no further work to be done on the terminology; the integration has already been achieved.&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis also however includes a process for integrating incongruent diagnoses, &amp;amp; the second diagnostic scenario showcases this. As above, sometimes two diagnoses seem to duplicate each other at the symptom-level, with each potentially giving rise to the same pattern of symptoms reported by a certain patient. Contrary to above, the two overlapping symptom-patterns (anxiety and ADHD) have not yet been deconstructed by cognitive science into traits which are modular, non-overlapping, and mutually compatible. In the case where an initial diagnosis of anxiety does not respond to treatment as anticipated, the entire initial symptom category (anxiety) must now be scrapped &amp;amp; rethought, since none of the patient’s history &amp;amp; self-report surveys (framed in the terminology of anxiety) are immediately reinterpretable from the perspective of ADHD. The old documentation is organized according to traits from the anxiety model (where each trait groups the attributes as they commonly cooccur in the context of anxiety); ADHD, however, would group these very same attributes differently. Thus, the documented anxiety-traits must be decomposed into more-granular attributes that can then be recomposed into the ADHD-terminology’s preferred groupings. This recombination-process is intensely demanding of a medical practitioner, because expanding a named trait into more-granular attributes involves naming these attributes (and thus inventing an idiosyncratic &amp;amp; patient-specific terminology) as the old documentation is reanalyzed in terms of new patterns. An alternative approach would be to restart the diagnostic process from scratch in light of ADHD, &amp;amp; reuse none of the old documentation beyond an intuitive gist-based reframing. In summary: anxiety’s attribute-groupings do not map cleanly onto ADHD’s attribute-groupings, and thus the process of Differential Diagnosis impels practitioners to either perform an ad-hoc integration of the two terminologies, or scrap one terminology (&amp;amp; thus their effort on documentation) in order to try out the other diagnosis. This is a friction, and a cost in terms of the practitioner’s time and the patient’s delayed (or *never* successfully reached) diagnosis. It is a friction that would be reduced by a better-integrated terminology between the two symptom-patterns. This would mean standardizing a more-granular set of traits, perhaps in terms of underlying cognitive processes such as attention &amp;amp; memory, which can be satisfactorily grouped into a higher-level tier of ADHD traits, and grouped in a different way to produce a higher-level tier of anxiety traits. The underlying traits would thus be modular, non-overlapping, and mutually compatible, and would comprise an integrated terminology for the symptom-patterns &amp;amp; treatment-responses of both diagnoses.&lt;br /&gt;
&lt;br /&gt;
An Integrated Terminology for How to Integrate Terminologies&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis thus demonstrates the (medical) benefits of well-integrated terminology, and also illustrates an ad-hoc process *for integrating* terminology. In the following section I continue to describe this process more formally, by interacting it with related concepts drawn from [https://en.wikipedia.org/wiki/David_Marr_(neuroscientist)#Levels_of_analysis Marr's 3 levels of analysis] &amp;amp; Object Oriented Programming. Eventually I develop a fully granular set of terms which can satisfactorily explain all 3— Differential Diagnosis, Marr’s 3 Levels, &amp;amp; OOP. If this feels self-referential, in a “I’m so meta, even this acronym __ ____” sort of way, it should. It’s integrating terminologies for how to integrate terminologies; if the “process for integrating terminologies” were an operating rule (that operates on terminologies), here I portray an operating rule which can operate upon itself, and which thus comprises its own learning rule. The author finds this delightfully recursive in a Godel Incompleteness Theorem/Hofstadter’s Strange Loop kind of way.&lt;br /&gt;
&lt;br /&gt;
A concept from Marr’s 3 Levels (and another it misses)&lt;br /&gt;
&lt;br /&gt;
Here I elaborate a useful concept, abstracted from Marr’s 3 levels of analysis: the notion that 2 systems can appear the same at the specification level, while arising from 2 different sets of underlying mechanisms. In other words: two different algorithms can achieve the same specification, and if hidden inside a black box, they would be undistinguishable (since their behavior is isomorphic). Diagnosis thus involves reaching inside the black box to glimpse some component of the internal mechanisms. If two diagnoses manifest an identical symptom pattern, but respond differently to treatment or testing, then the act of treatment or testing effectively lifts a component from within the black box up to the surface, and takes something from the algorithmic level and inserts it as part of the specification; there’s now a distinction which differentiates the two algorithms, &amp;amp; which differentiates the diagnosis. Marr’s 3 levels (as far as I am aware) does not describe a process for moving something from the algorithm level up to the specification level, which is the entire focus of differential diagnosis. I will call this process “un-black-boxing” an attribute, or “un-glossing-over” a newly relevant distinction. I welcome additional candidate terms.&lt;br /&gt;
&lt;br /&gt;
Triskaphobia (of Marr’s 3 levels)&lt;br /&gt;
&lt;br /&gt;
Triskaphobia, quite prudently, advises us to beware of the number 3. Not all [triskaphobias](https://en.wikipedia.org/wiki/Triskaidekaphobia) are rational, but this particular version, on the contrary, is quite well-founded: it serves as a counterheuristic, a protective mechanism, against humankind’s broader tendency to [favor the number 3](https://en.wikipedia.org/wiki/Rule_of_three) when coming up with tidy explanations of reality. I suspect we overindex this number, favoring it as the proper number of categories within mental models, due to some combination of its mnemonic effectiveness and then applying the overgeneralization bias upon instances where the mental model’s 3 categories do happen to map well to reality (or when they pass an [F-test](https://en.wikipedia.org/wiki/F-test) with reality, so to speak, regarding how many variables to include). You can observe this overgeneralization bias internally, as a sense of finality and completeness (ie, the sensation as a conditioned response) which arises when encountering novel groups of 3. (A good experiment might be to see whether this self-report increases after priming participants with practical &amp;amp; time-tested trio-based mental models, such as that of pathos, ethos, and logos; to stop, drop, and roll; or to look both ways (and back again) before crossing the street.) Regarding the actual mnemonic effectiveness of “3” within mental models, it likely reflects a tradeoff where smaller numbers (i.e., remembering 2 causal factors instead of 3) have a reduced explanatory power for the world, yet larger numbers unduly burden [WM capacity](https://en.wikipedia.org/wiki/Working_memory) (with their additional details displacing the very cognitive processing which would seek to utilize them). This tradeoff &amp;amp; bias forms an [attractor landscape](https://en.wikipedia.org/wiki/Attractor) between the numbers 3 4 and 5, as evidenced by [cultures whose oral traditions note that the use of 2, 4, or even 5 categories is more common](https://www.booktenderswv.com/book/9780295746968). Therefor the number 3 is best approached with caution when found within mental models, and the attentive reader should now be primed to explore dimensionality-reduction of any 3-factor model they come across, or at least to delight in the [frequency illusion](https://en.wikipedia.org/wiki/Frequency_illusion) of 2-factor models appearing now seemingly everywhere… (and those with pattern-recognition abilities verging on schizophrenic might even take note of this paragraph’s 2-factor model of Triskaphobia.)&lt;br /&gt;
&lt;br /&gt;
- Prime example: theory/practice only has two levels. (it’s an illustration of black-boxing bc without the diagnostic, the two symptom patterns appear the same. The surface appearance is identical.) And look, Marr just did black boxing, but with 3.&lt;br /&gt;
- So black-boxing is the cooler thing, bc combined with differential diagnosis (between multiple models, and using one to *predict the other)*  it basically produces all the cool stuff that Marr’s 3 levels does.&lt;br /&gt;
    &lt;br /&gt;
    &lt;br /&gt;
&lt;br /&gt;
another thing which Marr’s 3 levels doesn’t have terminology for, and how this (makes more likely) a fallacy called “mistaking the map for the territory”&lt;br /&gt;
&lt;br /&gt;
- Example of “mistaking the map for the territory”: misdiagnosing ADHD as anxiety. This isn’t necessarily problematic; sometimes you have to try out a diagnosis, &amp;amp; the implicated diagnostics &amp;amp; treatments, before you move on to testing another diagnosis. “mistaking the map for the territory” is more when you’re not aware there’s a difference, and to be appropriately cautious (and ready to revise the map).&lt;br /&gt;
- (Marr’s 3 Levels doesn’t have many practical tips for *noticing when 2 things aren’t the same at the specification level; fortunately, Differential Diagnosis does)*&lt;br /&gt;
- Thus, Marr’s 3 levels is insufficient to ward off the following problem, which arose in the schema/attention literature. Remember that if you say “schemas were storing _ in his brain,” this is a shorthand, &amp;amp; we should stay attuned and aware of what it would look like if our schema theory is being extended into territory it no longer applies. Marr’s3 should take a lesson from Differential Diagnosis.&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Differential_Diagnosis_%26_Marr%E2%80%99s_3_Levels,_as_a_Paradigm_for_Integrating_Literatures&amp;diff=756</id>
		<title>Differential Diagnosis &amp; Marr’s 3 Levels, as a Paradigm for Integrating Literatures</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Differential_Diagnosis_%26_Marr%E2%80%99s_3_Levels,_as_a_Paradigm_for_Integrating_Literatures&amp;diff=756"/>
				<updated>2022-10-22T11:32:12Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;''By Luke Hafermann''&lt;br /&gt;
&lt;br /&gt;
This article doubles as a section of my QSS thesis, on designing an ADHD test for rapid episodic visualization-- I was trying to draw together a lit review across some rather-incongruent terminologies used by the memory literature &amp;amp; the attention-literature, and finally realized I'd have to modify some of the existing terms, since none of the existing terms captured the necessary distinctions. This sections follows a little section called &amp;quot;Justification for Proposing New Terms&amp;quot;, which hopefully means the reader’s now on board with me synthesizing some new terminology, since I’ve assured them I’m handling carefully their established terminology-efforts.&lt;br /&gt;
&lt;br /&gt;
==Differential Diagnosis==&lt;br /&gt;
&lt;br /&gt;
In medicine, using the wrong terminology to describe a patient’s symptom-pattern is dangerous, so practitioners are cautious about assuming that the current diagnosis is correct. *Differential Diagnosis,* as a paradigm, includes engrained methods for differentiating between two diagnoses (or integrating components of two diagnoses) in order to better explain a patient’s symptom-pattern. Differential Diagnosis, with its focus on the patient’s well-being, attempts to avoid undue bias toward one diagnosis (set of terms) over another.&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis inspires this paper’s approach toward integrating the attention and memory literature, since it provides a neutral process for creating consistent terminology without favoring one literature over another. It includes guidance on 1) what to do with duplicate terms &amp;amp; 2) what to do with a term that (while important within one literature) fails to capture an important distinction made by the other literature. &lt;br /&gt;
&lt;br /&gt;
These 2 considerations are first illustrated within a relatively straightforward scenario, involving Differential Diagnosis of ADHD-like-symptoms, when no further integration is needed. Here, the patient’s physician can draw upon a hypothetical, neatly-integrated theory of ADHD which documents 2 potential causes of this symptom pattern. Diagnosis then involves a relatively straightforward process of identifying the subset of causes present for this particular patient (either both, either, or none), and reflects the value of a well-integrated theory where the causes are modular, non-overlapping, and mutually compatible. It is not even clear in this context why a “duplicate term” would arise, &amp;amp; each term easily incorporates additional distinctions as necessary (without compromising its use in other contexts). This straightforward scenario illustrates an ideal where there is no further work to be done on the terminology; the integration has already been achieved.&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis also however includes a process for integrating incongruent diagnoses, &amp;amp; the second diagnostic scenario showcases this. As above, sometimes two diagnoses seem to duplicate each other at the symptom-level, with each potentially giving rise to the same pattern of symptoms reported by a certain patient. Contrary to above, the two overlapping symptom-patterns (anxiety and ADHD) have not yet been deconstructed by cognitive science into traits which are modular, non-overlapping, and mutually compatible. In the case where an initial diagnosis of anxiety does not respond to treatment as anticipated, the entire initial symptom category (anxiety) must now be scrapped &amp;amp; rethought, since none of the patient’s history &amp;amp; self-report surveys (framed in the terminology of anxiety) are immediately reinterpretable from the perspective of ADHD. The old documentation is organized according to traits from the anxiety model (where each trait groups the attributes as they commonly cooccur in the context of anxiety); ADHD, however, would group these very same attributes differently. Thus, the documented anxiety-traits must be decomposed into more-granular attributes that can then be recomposed into the ADHD-terminology’s preferred groupings. This recombination-process is intensely demanding of a medical practitioner, because expanding a named trait into more-granular attributes involves naming these attributes (and thus inventing an idiosyncratic &amp;amp; patient-specific terminology) as the old documentation is reanalyzed in terms of new patterns. An alternative approach would be to restart the diagnostic process from scratch in light of ADHD, &amp;amp; reuse none of the old documentation beyond an intuitive gist-based reframing. In summary: anxiety’s attribute-groupings do not map cleanly onto ADHD’s attribute-groupings, and thus the process of Differential Diagnosis impels practitioners to either perform an ad-hoc integration of the two terminologies, or scrap one terminology (&amp;amp; thus their effort on documentation) in order to try out the other diagnosis. This is a friction, and a cost in terms of the practitioner’s time and the patient’s delayed (or *never* successfully reached) diagnosis. It is a friction that would be reduced by a better-integrated terminology between the two symptom-patterns. This would mean standardizing a more-granular set of traits, perhaps in terms of underlying cognitive processes such as attention &amp;amp; memory, which can be satisfactorily grouped into a higher-level tier of ADHD traits, and grouped in a different way to produce a higher-level tier of anxiety traits. The underlying traits would thus be modular, non-overlapping, and mutually compatible, and would comprise an integrated terminology for the symptom-patterns &amp;amp; treatment-responses of both diagnoses.&lt;br /&gt;
&lt;br /&gt;
==An Integrated Terminology for How to Integrate Terminologies==&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis thus demonstrates the (medical) benefits of well-integrated terminology, and also illustrates an ad-hoc process *for integrating* terminology. In the following section I continue to describe this process more formally, by interacting it with related concepts drawn from [https://en.wikipedia.org/wiki/David_Marr_(neuroscientist)#Levels_of_analysis Marr's 3 levels of analysis] &amp;amp; Object Oriented Programming. Eventually I develop a fully granular set of terms which can satisfactorily explain all 3— Differential Diagnosis, Marr’s 3 Levels, &amp;amp; OOP. If this feels self-referential, in a “I’m so meta, even this acronym __ ____” sort of way, it should. It’s integrating terminologies for how to integrate terminologies; if the “process for integrating terminologies” were an operating rule (that operates on terminologies), here I portray an operating rule which can operate upon itself, and which thus comprises its own learning rule. The author finds this delightfully recursive in a Godel Incompleteness Theorem/Hofstadter’s Strange Loop kind of way.&lt;br /&gt;
&lt;br /&gt;
==A concept from Marr’s 3 Levels (and another it misses)==&lt;br /&gt;
&lt;br /&gt;
Here I elaborate a useful concept, abstracted from Marr’s 3 levels of analysis: the notion that 2 systems can appear the same at the specification level, while arising from 2 different sets of underlying mechanisms. In other words: two different algorithms can achieve the same specification, and if hidden inside a black box, they would be undistinguishable (since their behavior is isomorphic). Diagnosis thus involves reaching inside the black box to glimpse some component of the internal mechanisms. If two diagnoses manifest an identical symptom pattern, but respond differently to treatment or testing, then the act of treatment or testing effectively lifts a component from within the black box up to the surface, and takes something from the algorithmic level and inserts it as part of the specification; there’s now a distinction which differentiates the two algorithms, &amp;amp; which differentiates the diagnosis. Marr’s 3 levels (as far as I am aware) does not describe a process for moving something from the algorithm level up to the specification level, which is the entire focus of differential diagnosis. I will call this process “un-black-boxing” an attribute, or “un-glossing-over” a newly relevant distinction. I welcome additional candidate terms.&lt;br /&gt;
&lt;br /&gt;
==Triskaphobia (of Marr’s 3 levels)==&lt;br /&gt;
&lt;br /&gt;
Triskaphobia, quite prudently, advises us to beware of the number 3. Not all [triskaphobias](https://en.wikipedia.org/wiki/Triskaidekaphobia) are rational, but this particular version, on the contrary, is quite well-founded: it serves as a counterheuristic, a protective mechanism, against humankind’s broader tendency to [favor the number 3](https://en.wikipedia.org/wiki/Rule_of_three) when coming up with tidy explanations of reality. I suspect we overindex this number, favoring it as the proper number of categories within mental models, due to some combination of its mnemonic effectiveness and then applying the overgeneralization bias upon instances where the mental model’s 3 categories do happen to map well to reality (or when they pass an [F-test](https://en.wikipedia.org/wiki/F-test) with reality, so to speak, regarding how many variables to include). You can observe this overgeneralization bias internally, as a sense of finality and completeness (ie, the sensation as a conditioned response) which arises when encountering novel groups of 3. (A good experiment might be to see whether this self-report increases after priming participants with practical &amp;amp; time-tested trio-based mental models, such as that of pathos, ethos, and logos; to stop, drop, and roll; or to look both ways (and back again) before crossing the street.) Regarding the actual mnemonic effectiveness of “3” within mental models, it likely reflects a tradeoff where smaller numbers (i.e., remembering 2 causal factors instead of 3) have a reduced explanatory power for the world, yet larger numbers unduly burden [WM capacity](https://en.wikipedia.org/wiki/Working_memory) (with their additional details displacing the very cognitive processing which would seek to utilize them). This tradeoff &amp;amp; bias forms an [attractor landscape](https://en.wikipedia.org/wiki/Attractor) between the numbers 3 4 and 5, as evidenced by [cultures whose oral traditions note that the use of 2, 4, or even 5 categories is more common](https://www.booktenderswv.com/book/9780295746968). Therefor the number 3 is best approached with caution when found within mental models, and the attentive reader should now be primed to explore dimensionality-reduction of any 3-factor model they come across, or at least to delight in the [frequency illusion](https://en.wikipedia.org/wiki/Frequency_illusion) of 2-factor models appearing now seemingly everywhere… (and those with pattern-recognition abilities verging on schizophrenic might even take note of this paragraph’s 2-factor model of Triskaphobia.)&lt;br /&gt;
&lt;br /&gt;
* Prime example: theory/practice only has two levels. (it’s an illustration of black-boxing bc without the diagnostic, the two symptom patterns appear the same. The surface appearance is identical.) And look, Marr just did black boxing, but with 3.&lt;br /&gt;
* So black-boxing is the cooler thing, bc combined with differential diagnosis (between multiple models, and using one to *predict the other)*  it basically produces all the cool stuff that Marr’s 3 levels does.&lt;br /&gt;
    &lt;br /&gt;
    &lt;br /&gt;
&lt;br /&gt;
==another thing which Marr’s 3 levels doesn’t have terminology for, and how this (makes more likely) a fallacy called “mistaking the map for the territory”==&lt;br /&gt;
&lt;br /&gt;
* Example of “mistaking the map for the territory”: misdiagnosing ADHD as anxiety. This isn’t necessarily problematic; sometimes you have to try out a diagnosis, &amp;amp; the implicated diagnostics &amp;amp; treatments, before you move on to testing another diagnosis. “mistaking the map for the territory” is more when you’re not aware there’s a difference, and to be appropriately cautious (and ready to revise the map).&lt;br /&gt;
* (Marr’s 3 Levels doesn’t have many practical tips for *noticing when 2 things aren’t the same at the specification level; fortunately, Differential Diagnosis does)*&lt;br /&gt;
* Thus, Marr’s 3 levels is insufficient to ward off the following problem, which arose in the schema/attention literature. Remember that if you say “schemas were storing _ in his brain,” this is a shorthand, &amp;amp; we should stay attuned and aware of what it would look like if our schema theory is being extended into territory it no longer applies. Marr’s3 should take a lesson from Differential Diagnosis.&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Differential_Diagnosis_%26_Marr%E2%80%99s_3_Levels,_as_a_Paradigm_for_Integrating_Literatures&amp;diff=757</id>
		<title>Differential Diagnosis &amp; Marr’s 3 Levels, as a Paradigm for Integrating Literatures</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Differential_Diagnosis_%26_Marr%E2%80%99s_3_Levels,_as_a_Paradigm_for_Integrating_Literatures&amp;diff=757"/>
				<updated>2022-10-22T11:32:12Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;''By Luke Hafermann''&lt;br /&gt;
&lt;br /&gt;
This article doubles as a section of my QSS thesis, on designing an ADHD test for rapid episodic visualization-- I was trying to draw together a lit review across some rather-incongruent terminologies used by the memory literature &amp;amp; the attention-literature, and finally realized I'd have to modify some of the existing terms, since none of the existing terms captured the necessary distinctions. This sections follows a little section called &amp;quot;Justification for Proposing New Terms&amp;quot;, which hopefully means the reader’s now on board with me synthesizing some new terminology, since I’ve assured them I’m handling carefully their established terminology-efforts.&lt;br /&gt;
&lt;br /&gt;
==Differential Diagnosis==&lt;br /&gt;
&lt;br /&gt;
In medicine, using the wrong terminology to describe a patient’s symptom-pattern is dangerous, so practitioners are cautious about assuming that the current diagnosis is correct. *Differential Diagnosis,* as a paradigm, includes engrained methods for differentiating between two diagnoses (or integrating components of two diagnoses) in order to better explain a patient’s symptom-pattern. Differential Diagnosis, with its focus on the patient’s well-being, attempts to avoid undue bias toward one diagnosis (set of terms) over another.&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis inspires this paper’s approach toward integrating the attention and memory literature, since it provides a neutral process for creating consistent terminology without favoring one literature over another. It includes guidance on 1) what to do with duplicate terms &amp;amp; 2) what to do with a term that (while important within one literature) fails to capture an important distinction made by the other literature. &lt;br /&gt;
&lt;br /&gt;
These 2 considerations are first illustrated within a relatively straightforward scenario, involving Differential Diagnosis of ADHD-like-symptoms, when no further integration is needed. Here, the patient’s physician can draw upon a hypothetical, neatly-integrated theory of ADHD which documents 2 potential causes of this symptom pattern. Diagnosis then involves a relatively straightforward process of identifying the subset of causes present for this particular patient (either both, either, or none), and reflects the value of a well-integrated theory where the causes are modular, non-overlapping, and mutually compatible. It is not even clear in this context why a “duplicate term” would arise, &amp;amp; each term easily incorporates additional distinctions as necessary (without compromising its use in other contexts). This straightforward scenario illustrates an ideal where there is no further work to be done on the terminology; the integration has already been achieved.&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis also however includes a process for integrating incongruent diagnoses, &amp;amp; the second diagnostic scenario showcases this. As above, sometimes two diagnoses seem to duplicate each other at the symptom-level, with each potentially giving rise to the same pattern of symptoms reported by a certain patient. Contrary to above, the two overlapping symptom-patterns (anxiety and ADHD) have not yet been deconstructed by cognitive science into traits which are modular, non-overlapping, and mutually compatible. In the case where an initial diagnosis of anxiety does not respond to treatment as anticipated, the entire initial symptom category (anxiety) must now be scrapped &amp;amp; rethought, since none of the patient’s history &amp;amp; self-report surveys (framed in the terminology of anxiety) are immediately reinterpretable from the perspective of ADHD. The old documentation is organized according to traits from the anxiety model (where each trait groups the attributes as they commonly cooccur in the context of anxiety); ADHD, however, would group these very same attributes differently. Thus, the documented anxiety-traits must be decomposed into more-granular attributes that can then be recomposed into the ADHD-terminology’s preferred groupings. This recombination-process is intensely demanding of a medical practitioner, because expanding a named trait into more-granular attributes involves naming these attributes (and thus inventing an idiosyncratic &amp;amp; patient-specific terminology) as the old documentation is reanalyzed in terms of new patterns. An alternative approach would be to restart the diagnostic process from scratch in light of ADHD, &amp;amp; reuse none of the old documentation beyond an intuitive gist-based reframing. In summary: anxiety’s attribute-groupings do not map cleanly onto ADHD’s attribute-groupings, and thus the process of Differential Diagnosis impels practitioners to either perform an ad-hoc integration of the two terminologies, or scrap one terminology (&amp;amp; thus their effort on documentation) in order to try out the other diagnosis. This is a friction, and a cost in terms of the practitioner’s time and the patient’s delayed (or *never* successfully reached) diagnosis. It is a friction that would be reduced by a better-integrated terminology between the two symptom-patterns. This would mean standardizing a more-granular set of traits, perhaps in terms of underlying cognitive processes such as attention &amp;amp; memory, which can be satisfactorily grouped into a higher-level tier of ADHD traits, and grouped in a different way to produce a higher-level tier of anxiety traits. The underlying traits would thus be modular, non-overlapping, and mutually compatible, and would comprise an integrated terminology for the symptom-patterns &amp;amp; treatment-responses of both diagnoses.&lt;br /&gt;
&lt;br /&gt;
==An Integrated Terminology for How to Integrate Terminologies==&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis thus demonstrates the (medical) benefits of well-integrated terminology, and also illustrates an ad-hoc process *for integrating* terminology. In the following section I continue to describe this process more formally, by interacting it with related concepts drawn from [https://en.wikipedia.org/wiki/David_Marr_(neuroscientist)#Levels_of_analysis Marr's 3 levels of analysis] &amp;amp; [https://en.wikipedia.org/wiki/Object-oriented_programming Object Oriented Programming]. Eventually I develop a fully granular set of terms which can satisfactorily explain all 3— Differential Diagnosis, Marr’s 3 Levels, &amp;amp; OOP. If this feels self-referential, in a “I’m so meta, even this acronym __ ____” sort of way, it should. It’s integrating terminologies for how to integrate terminologies; if the “process for integrating terminologies” were an operating rule (that operates on terminologies), here I portray an operating rule which can operate upon itself, and which thus comprises its own learning rule. The author finds this delightfully recursive in a Godel Incompleteness Theorem/Hofstadter’s Strange Loop kind of way.&lt;br /&gt;
&lt;br /&gt;
==A concept from Marr’s 3 Levels (and another it misses)==&lt;br /&gt;
&lt;br /&gt;
Here I elaborate a useful concept, abstracted from Marr’s 3 levels of analysis: the notion that 2 systems can appear the same at the specification level, while arising from 2 different sets of underlying mechanisms. In other words: two different algorithms can achieve the same specification, and if hidden inside a black box, they would be undistinguishable (since their behavior is isomorphic). Diagnosis thus involves reaching inside the black box to glimpse some component of the internal mechanisms. If two diagnoses manifest an identical symptom pattern, but respond differently to treatment or testing, then the act of treatment or testing effectively lifts a component from within the black box up to the surface, and takes something from the algorithmic level and inserts it as part of the specification; there’s now a distinction which differentiates the two algorithms, &amp;amp; which differentiates the diagnosis. Marr’s 3 levels (as far as I am aware) does not describe a process for moving something from the algorithm level up to the specification level, which is the entire focus of differential diagnosis. I will call this process “un-black-boxing” an attribute, or “un-glossing-over” a newly relevant distinction. I welcome additional candidate terms.&lt;br /&gt;
&lt;br /&gt;
==Triskaphobia (of Marr’s 3 levels)==&lt;br /&gt;
&lt;br /&gt;
Triskaphobia, quite prudently, advises us to beware of the number 3. Not all [triskaphobias](https://en.wikipedia.org/wiki/Triskaidekaphobia) are rational, but this particular version, on the contrary, is quite well-founded: it serves as a counterheuristic, a protective mechanism, against humankind’s broader tendency to [favor the number 3](https://en.wikipedia.org/wiki/Rule_of_three) when coming up with tidy explanations of reality. I suspect we overindex this number, favoring it as the proper number of categories within mental models, due to some combination of its mnemonic effectiveness and then applying the overgeneralization bias upon instances where the mental model’s 3 categories do happen to map well to reality (or when they pass an [F-test](https://en.wikipedia.org/wiki/F-test) with reality, so to speak, regarding how many variables to include). You can observe this overgeneralization bias internally, as a sense of finality and completeness (ie, the sensation as a conditioned response) which arises when encountering novel groups of 3. (A good experiment might be to see whether this self-report increases after priming participants with practical &amp;amp; time-tested trio-based mental models, such as that of pathos, ethos, and logos; to stop, drop, and roll; or to look both ways (and back again) before crossing the street.) Regarding the actual mnemonic effectiveness of “3” within mental models, it likely reflects a tradeoff where smaller numbers (i.e., remembering 2 causal factors instead of 3) have a reduced explanatory power for the world, yet larger numbers unduly burden [WM capacity](https://en.wikipedia.org/wiki/Working_memory) (with their additional details displacing the very cognitive processing which would seek to utilize them). This tradeoff &amp;amp; bias forms an [attractor landscape](https://en.wikipedia.org/wiki/Attractor) between the numbers 3 4 and 5, as evidenced by [cultures whose oral traditions note that the use of 2, 4, or even 5 categories is more common](https://www.booktenderswv.com/book/9780295746968). Therefor the number 3 is best approached with caution when found within mental models, and the attentive reader should now be primed to explore dimensionality-reduction of any 3-factor model they come across, or at least to delight in the [frequency illusion](https://en.wikipedia.org/wiki/Frequency_illusion) of 2-factor models appearing now seemingly everywhere… (and those with pattern-recognition abilities verging on schizophrenic might even take note of this paragraph’s 2-factor model of Triskaphobia.)&lt;br /&gt;
&lt;br /&gt;
* Prime example: theory/practice only has two levels. (it’s an illustration of black-boxing bc without the diagnostic, the two symptom patterns appear the same. The surface appearance is identical.) And look, Marr just did black boxing, but with 3.&lt;br /&gt;
* So black-boxing is the cooler thing, bc combined with differential diagnosis (between multiple models, and using one to *predict the other)*  it basically produces all the cool stuff that Marr’s 3 levels does.&lt;br /&gt;
    &lt;br /&gt;
    &lt;br /&gt;
&lt;br /&gt;
==another thing which Marr’s 3 levels doesn’t have terminology for, and how this (makes more likely) a fallacy called “mistaking the map for the territory”==&lt;br /&gt;
&lt;br /&gt;
* Example of “mistaking the map for the territory”: misdiagnosing ADHD as anxiety. This isn’t necessarily problematic; sometimes you have to try out a diagnosis, &amp;amp; the implicated diagnostics &amp;amp; treatments, before you move on to testing another diagnosis. “mistaking the map for the territory” is more when you’re not aware there’s a difference, and to be appropriately cautious (and ready to revise the map).&lt;br /&gt;
* (Marr’s 3 Levels doesn’t have many practical tips for *noticing when 2 things aren’t the same at the specification level; fortunately, Differential Diagnosis does)*&lt;br /&gt;
* Thus, Marr’s 3 levels is insufficient to ward off the following problem, which arose in the schema/attention literature. Remember that if you say “schemas were storing _ in his brain,” this is a shorthand, &amp;amp; we should stay attuned and aware of what it would look like if our schema theory is being extended into territory it no longer applies. Marr’s3 should take a lesson from Differential Diagnosis.&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Differential_Diagnosis_%26_Marr%E2%80%99s_3_Levels,_as_a_Paradigm_for_Integrating_Literatures&amp;diff=758</id>
		<title>Differential Diagnosis &amp; Marr’s 3 Levels, as a Paradigm for Integrating Literatures</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Differential_Diagnosis_%26_Marr%E2%80%99s_3_Levels,_as_a_Paradigm_for_Integrating_Literatures&amp;diff=758"/>
				<updated>2022-10-22T11:32:12Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;''By Luke Hafermann''&lt;br /&gt;
&lt;br /&gt;
This article doubles as a section of my QSS thesis, on designing an ADHD test for rapid episodic visualization-- I was trying to draw together a lit review across some rather-incongruent terminologies used by the memory literature &amp;amp; the attention-literature, and finally realized I'd have to modify some of the existing terms, since none of the existing terms captured the necessary distinctions. This sections follows a little section called &amp;quot;Justification for Proposing New Terms&amp;quot;, which hopefully means the reader’s now on board with me synthesizing some new terminology, since I’ve assured them I’m handling carefully their established terminology-efforts.&lt;br /&gt;
&lt;br /&gt;
==Differential Diagnosis==&lt;br /&gt;
&lt;br /&gt;
In medicine, using the wrong terminology to describe a patient’s symptom-pattern is dangerous, so practitioners are cautious about assuming that the current diagnosis is correct. *Differential Diagnosis,* as a paradigm, includes engrained methods for differentiating between two diagnoses (or integrating components of two diagnoses) in order to better explain a patient’s symptom-pattern. Differential Diagnosis, with its focus on the patient’s well-being, attempts to avoid undue bias toward one diagnosis (set of terms) over another.&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis inspires this paper’s approach toward integrating the attention and memory literature, since it provides a neutral process for creating consistent terminology without favoring one literature over another. It includes guidance on 1) what to do with duplicate terms &amp;amp; 2) what to do with a term that (while important within one literature) fails to capture an important distinction made by the other literature. &lt;br /&gt;
&lt;br /&gt;
These 2 considerations are first illustrated within a relatively straightforward scenario, involving Differential Diagnosis of ADHD-like-symptoms, when no further integration is needed. Here, the patient’s physician can draw upon a hypothetical, neatly-integrated theory of ADHD which documents 2 potential causes of this symptom pattern. Diagnosis then involves a relatively straightforward process of identifying the subset of causes present for this particular patient (either both, either, or none), and reflects the value of a well-integrated theory where the causes are modular, non-overlapping, and mutually compatible. It is not even clear in this context why a “duplicate term” would arise, &amp;amp; each term easily incorporates additional distinctions as necessary (without compromising its use in other contexts). This straightforward scenario illustrates an ideal where there is no further work to be done on the terminology; the integration has already been achieved.&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis also however includes a process for integrating incongruent diagnoses, &amp;amp; the second diagnostic scenario showcases this. As above, sometimes two diagnoses seem to duplicate each other at the symptom-level, with each potentially giving rise to the same pattern of symptoms reported by a certain patient. Contrary to above, the two overlapping symptom-patterns (anxiety and ADHD) have not yet been deconstructed by cognitive science into traits which are modular, non-overlapping, and mutually compatible. In the case where an initial diagnosis of anxiety does not respond to treatment as anticipated, the entire initial symptom category (anxiety) must now be scrapped &amp;amp; rethought, since none of the patient’s history &amp;amp; self-report surveys (framed in the terminology of anxiety) are immediately reinterpretable from the perspective of ADHD. The old documentation is organized according to traits from the anxiety model (where each trait groups the attributes as they commonly cooccur in the context of anxiety); ADHD, however, would group these very same attributes differently. Thus, the documented anxiety-traits must be decomposed into more-granular attributes that can then be recomposed into the ADHD-terminology’s preferred groupings. This recombination-process is intensely demanding of a medical practitioner, because expanding a named trait into more-granular attributes involves naming these attributes (and thus inventing an idiosyncratic &amp;amp; patient-specific terminology) as the old documentation is reanalyzed in terms of new patterns. An alternative approach would be to restart the diagnostic process from scratch in light of ADHD, &amp;amp; reuse none of the old documentation beyond an intuitive gist-based reframing. In summary: anxiety’s attribute-groupings do not map cleanly onto ADHD’s attribute-groupings, and thus the process of Differential Diagnosis impels practitioners to either perform an ad-hoc integration of the two terminologies, or scrap one terminology (&amp;amp; thus their effort on documentation) in order to try out the other diagnosis. This is a friction, and a cost in terms of the practitioner’s time and the patient’s delayed (or *never* successfully reached) diagnosis. It is a friction that would be reduced by a better-integrated terminology between the two symptom-patterns. This would mean standardizing a more-granular set of traits, perhaps in terms of underlying cognitive processes such as attention &amp;amp; memory, which can be satisfactorily grouped into a higher-level tier of ADHD traits, and grouped in a different way to produce a higher-level tier of anxiety traits. The underlying traits would thus be modular, non-overlapping, and mutually compatible, and would comprise an integrated terminology for the symptom-patterns &amp;amp; treatment-responses of both diagnoses.&lt;br /&gt;
&lt;br /&gt;
==An Integrated Terminology for How to Integrate Terminologies==&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis thus demonstrates the (medical) benefits of well-integrated terminology, and also illustrates an ad-hoc process *for integrating* terminology. In the following section I continue to describe this process more formally, by interacting it with related concepts drawn from [https://en.wikipedia.org/wiki/David_Marr_(neuroscientist)#Levels_of_analysis Marr's 3 levels of analysis] &amp;amp; [https://en.wikipedia.org/wiki/Object-oriented_programming Object Oriented Programming]. Eventually I develop a fully granular set of terms which can satisfactorily explain all 3— Differential Diagnosis, Marr’s 3 Levels, &amp;amp; OOP. If this feels self-referential, in a “I’m so meta, even this acronym __ ____” sort of way, it should. It’s integrating terminologies for how to integrate terminologies; if the “process for integrating terminologies” were an operating rule (that operates on terminologies), here I portray an operating rule which can operate upon itself, and which thus comprises its own learning rule. The author finds this delightfully recursive in a Godel Incompleteness Theorem/[https://en.wikipedia.org/wiki/Strange_loop Hofstadter’s Strange Loop] kind of way.&lt;br /&gt;
&lt;br /&gt;
==A concept from Marr’s 3 Levels (and another it misses)==&lt;br /&gt;
&lt;br /&gt;
Here I elaborate a useful concept, abstracted from Marr’s 3 levels of analysis: the notion that 2 systems can appear the same at the specification level, while arising from 2 different sets of underlying mechanisms. In other words: two different algorithms can achieve the same specification, and if hidden inside a black box, they would be undistinguishable (since their behavior is isomorphic). Diagnosis thus involves reaching inside the black box to glimpse some component of the internal mechanisms. If two diagnoses manifest an identical symptom pattern, but respond differently to treatment or testing, then the act of treatment or testing effectively lifts a component from within the black box up to the surface, and takes something from the algorithmic level and inserts it as part of the specification; there’s now a distinction which differentiates the two algorithms, &amp;amp; which differentiates the diagnosis. Marr’s 3 levels (as far as I am aware) does not describe a process for moving something from the algorithm level up to the specification level, which is the entire focus of differential diagnosis. I will call this process “un-black-boxing” an attribute, or “un-glossing-over” a newly relevant distinction. I welcome additional candidate terms.&lt;br /&gt;
&lt;br /&gt;
==Triskaphobia (of Marr’s 3 levels)==&lt;br /&gt;
&lt;br /&gt;
Triskaphobia, quite prudently, advises us to beware of the number 3. Not all [https://en.wikipedia.org/wiki/Triskaidekaphobia triskaphobias] are rational, but this particular version, on the contrary, is quite well-founded: it serves as a counterheuristic, a protective mechanism, against humankind’s broader tendency to [https://en.wikipedia.org/wiki/Rule_of_three favor the number 3] when coming up with tidy explanations of reality. I suspect we overindex this number, favoring it as the proper number of categories within mental models, due to some combination of its mnemonic effectiveness and then applying the overgeneralization bias upon instances where the mental model’s 3 categories do happen to map well to reality (or when they pass an [https://en.wikipedia.org/wiki/F-test F-test] with reality, so to speak, regarding how many variables to include). You can observe this overgeneralization bias internally, as a sense of finality and completeness (ie, the sensation as a conditioned response) which arises when encountering novel groups of 3. (A good experiment might be to see whether this self-report increases after priming participants with practical &amp;amp; time-tested trio-based mental models, such as that of pathos, ethos, and logos; to stop, drop, and roll; or to look both ways (and back again) before crossing the street.) Regarding the actual mnemonic effectiveness of “3” within mental models, it likely reflects a tradeoff where smaller numbers (i.e., remembering 2 causal factors instead of 3) have a reduced explanatory power for the world, yet larger numbers unduly burden [https://en.wikipedia.org/wiki/Working_memory WM capacity] (with their additional details displacing the very cognitive processing which would seek to utilize them). This tradeoff &amp;amp; bias forms an [https://en.wikipedia.org/wiki/Attractor attractor landscape] between the numbers 3 4 and 5, as evidenced by [https://www.booktenderswv.com/book/9780295746968 cultures whose oral traditions note that the use of 2, 4, or even 5 categories is more common]. Therefor the number 3 is best approached with caution when found within mental models, and the attentive reader should now be primed to explore dimensionality-reduction of any 3-factor model they come across, or at least to delight in the [https://en.wikipedia.org/wiki/Frequency_illusion frequency illusion] of 2-factor models appearing now seemingly everywhere… (and those with pattern-recognition abilities verging on schizophrenic might even take note of this paragraph’s 2-factor model of Triskaphobia.)&lt;br /&gt;
&lt;br /&gt;
* Prime example: theory/practice only has two levels. (it’s an illustration of black-boxing bc without the diagnostic, the two symptom patterns appear the same. The surface appearance is identical.) And look, Marr just did black boxing, but with 3.&lt;br /&gt;
* So black-boxing is the cooler thing, bc combined with differential diagnosis (between multiple models, and using one to *predict the other)*  it basically produces all the cool stuff that Marr’s 3 levels does.&lt;br /&gt;
    &lt;br /&gt;
    &lt;br /&gt;
&lt;br /&gt;
==another thing which Marr’s 3 levels doesn’t have terminology for, and how this (makes more likely) a fallacy called “mistaking the map for the territory”==&lt;br /&gt;
&lt;br /&gt;
* Example of [https://en.wikipedia.org/wiki/Map%E2%80%93territory_relation “mistaking the map for the territory”]: misdiagnosing ADHD as anxiety. This isn’t necessarily a problem with the diagnostic process; sometimes you have to try out a diagnosis, &amp;amp; the implicated diagnostics &amp;amp; treatments, before you move on to testing another diagnosis. “mistaking the map for the territory” is more when you’re not aware there’s a difference, and to be appropriately cautious (and ready to revise the map).&lt;br /&gt;
* (Marr’s 3 Levels doesn’t have many practical tips for *noticing when 2 things aren’t the same at the specification level; fortunately, Differential Diagnosis does)*&lt;br /&gt;
* Thus, Marr’s 3 levels is insufficient to ward off the following problem, which arose in the schema/attention literature. Remember that if you say “schemas were storing _ in his brain,” this is a shorthand, &amp;amp; we should stay attuned and aware of what it would look like if our schema theory is being extended into territory it no longer applies. Marr’s3 should take a lesson from Differential Diagnosis.&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Differential_Diagnosis_%26_Marr%E2%80%99s_3_Levels,_as_a_Paradigm_for_Integrating_Literatures&amp;diff=759</id>
		<title>Differential Diagnosis &amp; Marr’s 3 Levels, as a Paradigm for Integrating Literatures</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Differential_Diagnosis_%26_Marr%E2%80%99s_3_Levels,_as_a_Paradigm_for_Integrating_Literatures&amp;diff=759"/>
				<updated>2022-10-22T11:32:12Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* another thing which Marr’s 3 levels doesn’t have terminology for, and how this (makes more likely) a fallacy called “mistaking the map for the territory” */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;''By Luke Hafermann''&lt;br /&gt;
&lt;br /&gt;
This article doubles as a section of my QSS thesis, on designing an ADHD test for rapid episodic visualization-- I was trying to draw together a lit review across some rather-incongruent terminologies used by the memory literature &amp;amp; the attention-literature, and finally realized I'd have to modify some of the existing terms, since none of the existing terms captured the necessary distinctions. This sections follows a little section called &amp;quot;Justification for Proposing New Terms&amp;quot;, which hopefully means the reader’s now on board with me synthesizing some new terminology, since I’ve assured them I’m handling carefully their established terminology-efforts.&lt;br /&gt;
&lt;br /&gt;
==Differential Diagnosis==&lt;br /&gt;
&lt;br /&gt;
In medicine, using the wrong terminology to describe a patient’s symptom-pattern is dangerous, so practitioners are cautious about assuming that the current diagnosis is correct. *Differential Diagnosis,* as a paradigm, includes engrained methods for differentiating between two diagnoses (or integrating components of two diagnoses) in order to better explain a patient’s symptom-pattern. Differential Diagnosis, with its focus on the patient’s well-being, attempts to avoid undue bias toward one diagnosis (set of terms) over another.&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis inspires this paper’s approach toward integrating the attention and memory literature, since it provides a neutral process for creating consistent terminology without favoring one literature over another. It includes guidance on 1) what to do with duplicate terms &amp;amp; 2) what to do with a term that (while important within one literature) fails to capture an important distinction made by the other literature. &lt;br /&gt;
&lt;br /&gt;
These 2 considerations are first illustrated within a relatively straightforward scenario, involving Differential Diagnosis of ADHD-like-symptoms, when no further integration is needed. Here, the patient’s physician can draw upon a hypothetical, neatly-integrated theory of ADHD which documents 2 potential causes of this symptom pattern. Diagnosis then involves a relatively straightforward process of identifying the subset of causes present for this particular patient (either both, either, or none), and reflects the value of a well-integrated theory where the causes are modular, non-overlapping, and mutually compatible. It is not even clear in this context why a “duplicate term” would arise, &amp;amp; each term easily incorporates additional distinctions as necessary (without compromising its use in other contexts). This straightforward scenario illustrates an ideal where there is no further work to be done on the terminology; the integration has already been achieved.&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis also however includes a process for integrating incongruent diagnoses, &amp;amp; the second diagnostic scenario showcases this. As above, sometimes two diagnoses seem to duplicate each other at the symptom-level, with each potentially giving rise to the same pattern of symptoms reported by a certain patient. Contrary to above, the two overlapping symptom-patterns (anxiety and ADHD) have not yet been deconstructed by cognitive science into traits which are modular, non-overlapping, and mutually compatible. In the case where an initial diagnosis of anxiety does not respond to treatment as anticipated, the entire initial symptom category (anxiety) must now be scrapped &amp;amp; rethought, since none of the patient’s history &amp;amp; self-report surveys (framed in the terminology of anxiety) are immediately reinterpretable from the perspective of ADHD. The old documentation is organized according to traits from the anxiety model (where each trait groups the attributes as they commonly cooccur in the context of anxiety); ADHD, however, would group these very same attributes differently. Thus, the documented anxiety-traits must be decomposed into more-granular attributes that can then be recomposed into the ADHD-terminology’s preferred groupings. This recombination-process is intensely demanding of a medical practitioner, because expanding a named trait into more-granular attributes involves naming these attributes (and thus inventing an idiosyncratic &amp;amp; patient-specific terminology) as the old documentation is reanalyzed in terms of new patterns. An alternative approach would be to restart the diagnostic process from scratch in light of ADHD, &amp;amp; reuse none of the old documentation beyond an intuitive gist-based reframing. In summary: anxiety’s attribute-groupings do not map cleanly onto ADHD’s attribute-groupings, and thus the process of Differential Diagnosis impels practitioners to either perform an ad-hoc integration of the two terminologies, or scrap one terminology (&amp;amp; thus their effort on documentation) in order to try out the other diagnosis. This is a friction, and a cost in terms of the practitioner’s time and the patient’s delayed (or *never* successfully reached) diagnosis. It is a friction that would be reduced by a better-integrated terminology between the two symptom-patterns. This would mean standardizing a more-granular set of traits, perhaps in terms of underlying cognitive processes such as attention &amp;amp; memory, which can be satisfactorily grouped into a higher-level tier of ADHD traits, and grouped in a different way to produce a higher-level tier of anxiety traits. The underlying traits would thus be modular, non-overlapping, and mutually compatible, and would comprise an integrated terminology for the symptom-patterns &amp;amp; treatment-responses of both diagnoses.&lt;br /&gt;
&lt;br /&gt;
==An Integrated Terminology for How to Integrate Terminologies==&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis thus demonstrates the (medical) benefits of well-integrated terminology, and also illustrates an ad-hoc process *for integrating* terminology. In the following section I continue to describe this process more formally, by interacting it with related concepts drawn from [https://en.wikipedia.org/wiki/David_Marr_(neuroscientist)#Levels_of_analysis Marr's 3 levels of analysis] &amp;amp; [https://en.wikipedia.org/wiki/Object-oriented_programming Object Oriented Programming]. Eventually I develop a fully granular set of terms which can satisfactorily explain all 3— Differential Diagnosis, Marr’s 3 Levels, &amp;amp; OOP. If this feels self-referential, in a “I’m so meta, even this acronym __ ____” sort of way, it should. It’s integrating terminologies for how to integrate terminologies; if the “process for integrating terminologies” were an operating rule (that operates on terminologies), here I portray an operating rule which can operate upon itself, and which thus comprises its own learning rule. The author finds this delightfully recursive in a Godel Incompleteness Theorem/[https://en.wikipedia.org/wiki/Strange_loop Hofstadter’s Strange Loop] kind of way.&lt;br /&gt;
&lt;br /&gt;
==A concept from Marr’s 3 Levels (and another it misses)==&lt;br /&gt;
&lt;br /&gt;
Here I elaborate a useful concept, abstracted from Marr’s 3 levels of analysis: the notion that 2 systems can appear the same at the specification level, while arising from 2 different sets of underlying mechanisms. In other words: two different algorithms can achieve the same specification, and if hidden inside a black box, they would be undistinguishable (since their behavior is isomorphic). Diagnosis thus involves reaching inside the black box to glimpse some component of the internal mechanisms. If two diagnoses manifest an identical symptom pattern, but respond differently to treatment or testing, then the act of treatment or testing effectively lifts a component from within the black box up to the surface, and takes something from the algorithmic level and inserts it as part of the specification; there’s now a distinction which differentiates the two algorithms, &amp;amp; which differentiates the diagnosis. Marr’s 3 levels (as far as I am aware) does not describe a process for moving something from the algorithm level up to the specification level, which is the entire focus of differential diagnosis. I will call this process “un-black-boxing” an attribute, or “un-glossing-over” a newly relevant distinction. I welcome additional candidate terms.&lt;br /&gt;
&lt;br /&gt;
==Triskaphobia (of Marr’s 3 levels)==&lt;br /&gt;
&lt;br /&gt;
Triskaphobia, quite prudently, advises us to beware of the number 3. Not all [https://en.wikipedia.org/wiki/Triskaidekaphobia triskaphobias] are rational, but this particular version, on the contrary, is quite well-founded: it serves as a counterheuristic, a protective mechanism, against humankind’s broader tendency to [https://en.wikipedia.org/wiki/Rule_of_three favor the number 3] when coming up with tidy explanations of reality. I suspect we overindex this number, favoring it as the proper number of categories within mental models, due to some combination of its mnemonic effectiveness and then applying the overgeneralization bias upon instances where the mental model’s 3 categories do happen to map well to reality (or when they pass an [https://en.wikipedia.org/wiki/F-test F-test] with reality, so to speak, regarding how many variables to include). You can observe this overgeneralization bias internally, as a sense of finality and completeness (ie, the sensation as a conditioned response) which arises when encountering novel groups of 3. (A good experiment might be to see whether this self-report increases after priming participants with practical &amp;amp; time-tested trio-based mental models, such as that of pathos, ethos, and logos; to stop, drop, and roll; or to look both ways (and back again) before crossing the street.) Regarding the actual mnemonic effectiveness of “3” within mental models, it likely reflects a tradeoff where smaller numbers (i.e., remembering 2 causal factors instead of 3) have a reduced explanatory power for the world, yet larger numbers unduly burden [https://en.wikipedia.org/wiki/Working_memory WM capacity] (with their additional details displacing the very cognitive processing which would seek to utilize them). This tradeoff &amp;amp; bias forms an [https://en.wikipedia.org/wiki/Attractor attractor landscape] between the numbers 3 4 and 5, as evidenced by [https://www.booktenderswv.com/book/9780295746968 cultures whose oral traditions note that the use of 2, 4, or even 5 categories is more common]. Therefor the number 3 is best approached with caution when found within mental models, and the attentive reader should now be primed to explore dimensionality-reduction of any 3-factor model they come across, or at least to delight in the [https://en.wikipedia.org/wiki/Frequency_illusion frequency illusion] of 2-factor models appearing now seemingly everywhere… (and those with pattern-recognition abilities verging on schizophrenic might even take note of this paragraph’s 2-factor model of Triskaphobia.)&lt;br /&gt;
&lt;br /&gt;
* Prime example: theory/practice only has two levels. (it’s an illustration of black-boxing bc without the diagnostic, the two symptom patterns appear the same. The surface appearance is identical.) And look, Marr just did black boxing, but with 3.&lt;br /&gt;
* So black-boxing is the cooler thing, bc combined with differential diagnosis (between multiple models, and using one to *predict the other)*  it basically produces all the cool stuff that Marr’s 3 levels does.&lt;br /&gt;
    &lt;br /&gt;
    &lt;br /&gt;
&lt;br /&gt;
==Another thing which Marr’s 3 levels doesn’t have terminology for, and how this (makes more likely) a fallacy called “mistaking the map for the territory”==&lt;br /&gt;
&lt;br /&gt;
* Example of [https://en.wikipedia.org/wiki/Map%E2%80%93territory_relation “mistaking the map for the territory”]: misdiagnosing ADHD as anxiety. This isn’t necessarily a problem with the diagnostic process; sometimes you have to try out a diagnosis, &amp;amp; the implicated diagnostics &amp;amp; treatments, before you move on to testing another diagnosis. “mistaking the map for the territory” is more when you’re not aware there’s a difference, and to be appropriately cautious (and ready to revise the map).&lt;br /&gt;
* (Marr’s 3 Levels doesn’t have many practical tips for *noticing when 2 things aren’t the same at the specification level; fortunately, Differential Diagnosis does)*&lt;br /&gt;
* Thus, Marr’s 3 levels is insufficient to ward off the following problem, which arose in the schema/attention literature. Remember that if you say “schemas were storing _ in his brain,” this is a shorthand, &amp;amp; we should stay attuned and aware of what it would look like if our schema theory is being extended into territory it no longer applies. Marr’s3 should take a lesson from Differential Diagnosis.&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Differential_Diagnosis_%26_Marr%E2%80%99s_3_Levels,_as_a_Paradigm_for_Integrating_Literatures&amp;diff=760</id>
		<title>Differential Diagnosis &amp; Marr’s 3 Levels, as a Paradigm for Integrating Literatures</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Differential_Diagnosis_%26_Marr%E2%80%99s_3_Levels,_as_a_Paradigm_for_Integrating_Literatures&amp;diff=760"/>
				<updated>2022-10-22T11:32:12Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;''By Luke Hafermann''&lt;br /&gt;
&lt;br /&gt;
This article describes a process for integrating incongruent terminologies, drawing on the concept of differential diagnosis from medicine, as well as Marr's 3 Levels of Analysis. I came up with the idea in order to better organize the literature review for my QSS thesis, &amp;amp; I'll probably put most of this into my thesis paper, following a little section called &amp;quot;Justification for Proposing New Terms&amp;quot;, which hopefully assures the reader that I'm handling carefully their established terminology-efforts, and means that they're now on board with me synthesizing some new terminology (not included here; this wiki's just the process!).&lt;br /&gt;
&lt;br /&gt;
==Differential Diagnosis==&lt;br /&gt;
&lt;br /&gt;
In medicine, using the wrong terminology to describe a patient’s symptom-pattern is dangerous, so practitioners are cautious about assuming that the current diagnosis is correct. *Differential Diagnosis,* as a paradigm, includes engrained methods for differentiating between two diagnoses (or integrating components of two diagnoses) in order to better explain a patient’s symptom-pattern. Differential Diagnosis, with its focus on the patient’s well-being, attempts to avoid undue bias toward one diagnosis (set of terms) over another.&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis inspires this paper’s approach toward integrating the attention and memory literature, since it provides a neutral process for creating consistent terminology without favoring one literature over another. It includes guidance on 1) what to do with duplicate terms &amp;amp; 2) what to do with a term that (while important within one literature) fails to capture an important distinction made by the other literature. &lt;br /&gt;
&lt;br /&gt;
These 2 considerations are first illustrated within a relatively straightforward scenario, involving Differential Diagnosis of ADHD-like-symptoms, when no further integration is needed. Here, the patient’s physician can draw upon a hypothetical, neatly-integrated theory of ADHD which documents 2 potential causes of this symptom pattern. Diagnosis then involves a relatively straightforward process of identifying the subset of causes present for this particular patient (either both, either, or none), and reflects the value of a well-integrated theory where the causes are modular, non-overlapping, and mutually compatible. It is not even clear in this context why a “duplicate term” would arise, &amp;amp; each term easily incorporates additional distinctions as necessary (without compromising its use in other contexts). This straightforward scenario illustrates an ideal where there is no further work to be done on the terminology; the integration has already been achieved.&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis also however includes a process for integrating incongruent diagnoses, &amp;amp; the second diagnostic scenario showcases this. As above, sometimes two diagnoses seem to duplicate each other at the symptom-level, with each potentially giving rise to the same pattern of symptoms reported by a certain patient. Contrary to above, the two overlapping symptom-patterns (anxiety and ADHD) have not yet been deconstructed by cognitive science into traits which are modular, non-overlapping, and mutually compatible. In the case where an initial diagnosis of anxiety does not respond to treatment as anticipated, the entire initial symptom category (anxiety) must now be scrapped &amp;amp; rethought, since none of the patient’s history &amp;amp; self-report surveys (framed in the terminology of anxiety) are immediately reinterpretable from the perspective of ADHD. The old documentation is organized according to traits from the anxiety model (where each trait groups the attributes as they commonly cooccur in the context of anxiety); ADHD, however, would group these very same attributes differently. Thus, the documented anxiety-traits must be decomposed into more-granular attributes that can then be recomposed into the ADHD-terminology’s preferred groupings. This recombination-process is intensely demanding of a medical practitioner, because expanding a named trait into more-granular attributes involves naming these attributes (and thus inventing an idiosyncratic &amp;amp; patient-specific terminology) as the old documentation is reanalyzed in terms of new patterns. An alternative approach would be to restart the diagnostic process from scratch in light of ADHD, &amp;amp; reuse none of the old documentation beyond an intuitive gist-based reframing. In summary: anxiety’s attribute-groupings do not map cleanly onto ADHD’s attribute-groupings, and thus the process of Differential Diagnosis impels practitioners to either perform an ad-hoc integration of the two terminologies, or scrap one terminology (&amp;amp; thus their effort on documentation) in order to try out the other diagnosis. This is a friction, and a cost in terms of the practitioner’s time and the patient’s delayed (or *never* successfully reached) diagnosis. It is a friction that would be reduced by a better-integrated terminology between the two symptom-patterns. This would mean standardizing a more-granular set of traits, perhaps in terms of underlying cognitive processes such as attention &amp;amp; memory, which can be satisfactorily grouped into a higher-level tier of ADHD traits, and grouped in a different way to produce a higher-level tier of anxiety traits. The underlying traits would thus be modular, non-overlapping, and mutually compatible, and would comprise an integrated terminology for the symptom-patterns &amp;amp; treatment-responses of both diagnoses.&lt;br /&gt;
&lt;br /&gt;
==An Integrated Terminology for How to Integrate Terminologies==&lt;br /&gt;
&lt;br /&gt;
Differential Diagnosis thus demonstrates the (medical) benefits of well-integrated terminology, and also illustrates an ad-hoc process *for integrating* terminology. In the following section I continue to describe this process more formally, by interacting it with related concepts drawn from [https://en.wikipedia.org/wiki/David_Marr_(neuroscientist)#Levels_of_analysis Marr's 3 levels of analysis] &amp;amp; [https://en.wikipedia.org/wiki/Object-oriented_programming Object Oriented Programming]. Eventually I develop a fully granular set of terms which can satisfactorily explain all 3— Differential Diagnosis, Marr’s 3 Levels, &amp;amp; OOP. If this feels self-referential, in a “I’m so meta, even this acronym __ ____” sort of way, it should. It’s integrating terminologies for how to integrate terminologies; if the “process for integrating terminologies” were an operating rule (that operates on terminologies), here I portray an operating rule which can operate upon itself, and which thus comprises its own learning rule. The author finds this delightfully recursive in a Godel Incompleteness Theorem/[https://en.wikipedia.org/wiki/Strange_loop Hofstadter’s Strange Loop] kind of way.&lt;br /&gt;
&lt;br /&gt;
==A concept from Marr’s 3 Levels (and another it misses)==&lt;br /&gt;
&lt;br /&gt;
Here I elaborate a useful concept, abstracted from Marr’s 3 levels of analysis: the notion that 2 systems can appear the same at the specification level, while arising from 2 different sets of underlying mechanisms. In other words: two different algorithms can achieve the same specification, and if hidden inside a black box, they would be undistinguishable (since their behavior is isomorphic). Diagnosis thus involves reaching inside the black box to glimpse some component of the internal mechanisms. If two diagnoses manifest an identical symptom pattern, but respond differently to treatment or testing, then the act of treatment or testing effectively lifts a component from within the black box up to the surface, and takes something from the algorithmic level and inserts it as part of the specification; there’s now a distinction which differentiates the two algorithms, &amp;amp; which differentiates the diagnosis. Marr’s 3 levels (as far as I am aware) does not describe a process for moving something from the algorithm level up to the specification level, which is the entire focus of differential diagnosis. I will call this process “un-black-boxing” an attribute, or “un-glossing-over” a newly relevant distinction. I welcome additional candidate terms.&lt;br /&gt;
&lt;br /&gt;
==Triskaphobia (of Marr’s 3 levels)==&lt;br /&gt;
&lt;br /&gt;
Triskaphobia, quite prudently, advises us to beware of the number 3. Not all [https://en.wikipedia.org/wiki/Triskaidekaphobia triskaphobias] are rational, but this particular version, on the contrary, is quite well-founded: it serves as a counterheuristic, a protective mechanism, against humankind’s broader tendency to [https://en.wikipedia.org/wiki/Rule_of_three favor the number 3] when coming up with tidy explanations of reality. I suspect we overindex this number, favoring it as the proper number of categories within mental models, due to some combination of its mnemonic effectiveness and then applying the overgeneralization bias upon instances where the mental model’s 3 categories do happen to map well to reality (or when they pass an [https://en.wikipedia.org/wiki/F-test F-test] with reality, so to speak, regarding how many variables to include). You can observe this overgeneralization bias internally, as a sense of finality and completeness (ie, the sensation as a conditioned response) which arises when encountering novel groups of 3. (A good experiment might be to see whether this self-report increases after priming participants with practical &amp;amp; time-tested trio-based mental models, such as that of pathos, ethos, and logos; to stop, drop, and roll; or to look both ways (and back again) before crossing the street.) Regarding the actual mnemonic effectiveness of “3” within mental models, it likely reflects a tradeoff where smaller numbers (i.e., remembering 2 causal factors instead of 3) have a reduced explanatory power for the world, yet larger numbers unduly burden [https://en.wikipedia.org/wiki/Working_memory WM capacity] (with their additional details displacing the very cognitive processing which would seek to utilize them). This tradeoff &amp;amp; bias forms an [https://en.wikipedia.org/wiki/Attractor attractor landscape] between the numbers 3 4 and 5, as evidenced by [https://www.booktenderswv.com/book/9780295746968 cultures whose oral traditions note that the use of 2, 4, or even 5 categories is more common]. Therefor the number 3 is best approached with caution when found within mental models, and the attentive reader should now be primed to explore dimensionality-reduction of any 3-factor model they come across, or at least to delight in the [https://en.wikipedia.org/wiki/Frequency_illusion frequency illusion] of 2-factor models appearing now seemingly everywhere… (and those with pattern-recognition abilities verging on schizophrenic might even take note of this paragraph’s 2-factor model of Triskaphobia.)&lt;br /&gt;
&lt;br /&gt;
* Prime example: theory/practice only has two levels. (it’s an illustration of black-boxing bc without the diagnostic, the two symptom patterns appear the same. The surface appearance is identical.) And look, Marr just did black boxing, but with 3.&lt;br /&gt;
* So black-boxing is the cooler thing, bc combined with differential diagnosis (between multiple models, and using one to *predict the other)*  it basically produces all the cool stuff that Marr’s 3 levels does.&lt;br /&gt;
    &lt;br /&gt;
    &lt;br /&gt;
&lt;br /&gt;
==Another thing which Marr’s 3 levels doesn’t have terminology for, and how this (makes more likely) a fallacy called “mistaking the map for the territory”==&lt;br /&gt;
&lt;br /&gt;
* Example of [https://en.wikipedia.org/wiki/Map%E2%80%93territory_relation “mistaking the map for the territory”]: misdiagnosing ADHD as anxiety. This isn’t necessarily a problem with the diagnostic process; sometimes you have to try out a diagnosis, &amp;amp; the implicated diagnostics &amp;amp; treatments, before you move on to testing another diagnosis. “mistaking the map for the territory” is more when you’re not aware there’s a difference, and to be appropriately cautious (and ready to revise the map).&lt;br /&gt;
* (Marr’s 3 Levels doesn’t have many practical tips for *noticing when 2 things aren’t the same at the specification level; fortunately, Differential Diagnosis does)*&lt;br /&gt;
* Thus, Marr’s 3 levels is insufficient to ward off the following problem, which arose in the schema/attention literature. Remember that if you say “schemas were storing _ in his brain,” this is a shorthand, &amp;amp; we should stay attuned and aware of what it would look like if our schema theory is being extended into territory it no longer applies. Marr’s3 should take a lesson from Differential Diagnosis.&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=730</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=730"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* Philosophical implications of artificial models of semantic representation */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
&lt;br /&gt;
===References===&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Artificial_Intelligence_Music_Creation_with_Neural_Networks&amp;diff=731</id>
		<title>Artificial Intelligence Music Creation with Neural Networks</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Artificial_Intelligence_Music_Creation_with_Neural_Networks&amp;diff=731"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;''by Sid Singh''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
 Artificial Intelligence (AI) music creation is using generative artificial intelligence to produce music, often that aims to resemble human-made music. [https://en.wikipedia.org/wiki/Generative_artificial_intelligence]&lt;br /&gt;
To replicate human-created music compositions, a deep learning model is used. Deep learning models, a type of artificial neural network, are representations of the human brain that perform tasks such as classification and representation, such as finding a common note or pattern in music. [https://en.wikipedia.org/wiki/Deep_learning] The models use training data, such as human-made music, as well as hidden (&amp;quot;deep&amp;quot;) layers to train a randomized input into the desired output -- artificially created music that resembles a human creation. The use and popularity of music created by generative AI has skyrocketed in recent years [https://mixmag.net/read/73-of-producers-believe-ai-music-generators-could-replace-them-new-data-shows-tech], with its reception being a mixed bag of critics and believers. [https://www.nytimes.com/2023/05/11/learning/what-students-are-saying-about-ai-generated-music.html]&lt;br /&gt;
&lt;br /&gt;
'''History of AI Music'''&lt;br /&gt;
----&lt;br /&gt;
&lt;br /&gt;
 Artists and engineers have aimed to transcribe and recreate music since the 19th century, when music rolls were introduced commercially. Music rolls, typically made for reproducing piano, are sheets of paper with holes that model the notes and rhythm of music [https://www.pianola.org/history/history_rolls.cfm]. When these sheets are moved over a tracker bar, the instrument can recreate the piece without a human player. &lt;br /&gt;
&lt;br /&gt;
[[File:piano roll.jpg]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The modern-day, digital version of a music roll is a Musical Instrument Digital Interface (MIDI) file, which was introduced in the late 20th century by Dave Smith [https://hosatech.com/press-release/history-of-midi/]. Now, MIDI files are often the input for deep learning models to learn music. Before MIDI, though, AI music had already begun being generated; in 1957, composers Lejaren Hiller and Leonard Isaacson created The Illiac Suite, the first known computer-composed piece of music. [https://distributedmuseum.illinois.edu/exhibit/illiac-suite/] Since then, the scope and capability of Artificial music has greatly expanded. Recent projects such as Google's Magenta Project [https://magenta.tensorflow.org/] and OpenAI's MuseNet [https://openai.com/index/musenet/] allow users to give the computer certain requirements, such as instruments and lyrics to include, to create unique artificial arrangements. Artificial &amp;quot;deepfakes&amp;quot; of popular artists are another recent development of the AI music realm; the song &amp;quot;Heart on My Sleeve&amp;quot;, which imitates the voices of popular artists Drake and The Weeknd, gained over 15 million views on social media platform, TikTok, and over 600,000 streams on popular streaming platform Spotify. [https://www.washingtonpost.com/music/2023/04/26/ai-drake-weeknd/]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Recurrent Neural Networks (RNN)'''&lt;br /&gt;
&lt;br /&gt;
A recurrent neural network is a type of deep-learning model that takes a sequential set of inputs, puts it through hidden layers that have randomized weights, and then trains the model to eventually minimize the loss between the actual output and the desired output (the music desired). A recurrent neural network uses back-propagation, meaning the outputs of each node can be used as the new input. Since music is fundamentally a sequence of notes, rhythms, and pitches, the recurrent neural network is an ideal tool to generate an artificial musical output. Moreover, compared to a feed-forward or Conventional Neural Network (CNN), a recurrent neural network factors in the ordering of data points. [https://local.cis.strath.ac.uk/wp/extras/msctheses/papers/strath_cis_publication_2725.pdf] With music, the long-term sequence and order of notes are vital to predict every ensuing note, so a feed-forward network would not suffice.&lt;br /&gt;
&lt;br /&gt;
[[File:rnn.png]] [https://stanford.edu/~shervine/teaching/cs-230/cheatsheet-recurrent-neural-networks]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
A recurrent neural network works by receiving a sequential input, such as a MIDI file, which stores a set of musical notes, rhythm, and pitch. In a supervised recurrent neural network, the model would also receive a given output it should reach, which is a different sequence of musical notes, rhythm, and pitch. To reach this output layer, the model trains by going through nodes in layers, with a weight assigned to each node. The model takes the output from each layer at time t, as well as the given input, to use as the next input for time t + 1. As the model trains through its hidden layers, the weights of each node adjust to minimize the loss. [https://medium.com/@james.matson_64120/artificial-intelligence-music-creation-with-recurrent-neural-networks-rnn-be08d1d3c759] So, when given the input, the model will calculate the probability vector of each possible ensuing note/chord, rhythm, and pitch, given the previous inputs. Next, the model will compute the loss function and take the average of the loss on each note to get an overall loss function. The loss function can be implemented in various ways, but is commonly the cross-entropy loss function, which takes the difference between between the predicted output layer and the target output. Finally, the model will iterate and generate a new probability function given the new weights, until it eventually reaches the output layer. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
''' Limitations of the RNN'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
However, recurrent neural networks have a few problems that limit their capability; firstly, there is a vanishing gradient problem, which means the information stored in the earlier hidden layers of a network is lost because most of the back-propagated information comes from the later hidden layers. Moreover, the further you go into your network, the harder it is to train your model as the gradients (or slopes) get smaller and the weights given to the starting layers are smaller. A vanishing gradient problem occurs when the starting weights of the model are close to zero, and the gradients are less than 1. Given that the notes and rhythms at the start of a musical piece are important to predicting future notes and rhythms, the vanishing gradient problem limits the RNN's accuracy. [https://www.superdatascience.com/blogs/recurrent-neural-networks-rnn-the-vanishing-gradient-problem]&lt;br /&gt;
&lt;br /&gt;
[[File:vanishing gradient .png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Another challenge with RNNs, which is essentially the opposite of the vanishing gradient problem, is the exploding gradient. In this case, during the backpropagation of the network, the gradients (or slopes) of each hidden layer get exponentially larger as we move backward. The exploding gradient problem occurs when the initial weights are too high, which leads to higher ensuing gradients (which are greater than 1). The exploding gradient problem makes it tough for a model to converge to any values as the parameters become so large that they overflow. [[https://www.geeksforgeeks.org/vanishing-and-exploding-gradients-problems-in-deep-learning/]]&lt;br /&gt;
&lt;br /&gt;
'''Long-Short Term Memory (LSTM) Models ''' &lt;br /&gt;
&lt;br /&gt;
To solve the vanishing and exploding gradient problems in AI music generation, a Long-Short Term Memory (LSTM) model can be used, which is a variation of an RNN, that achieves better transmission of information between the layers in the neural network.[https://web.stanford.edu/class/archive/cs/cs224n/cs224n.1204/reports/custom/report11.pdf] An LSTM does this by including a forget gate/vector, along with an input and output, that controls the self-recurrent link of the memory cell to remember and forget previous states whenever required. [https://www.sciencedirect.com/science/article/abs/pii/B9780128213797000035] Numerically, this allows for the LSTM to control the gradient from being too high or too low, and set it equal to just 1.&lt;br /&gt;
&lt;br /&gt;
[[File:lstm model.webp]]&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=732</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=732"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* Conclusion */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
The exploration of semantics in artificial neural networks has profound implications for both science and philosophy. While artificial systems have made remarkable advancements in representing and processing semantic information, their methods remain fundamentally different from those of biological systems. These differences highlight critical questions about the nature of understanding, the role of experience in meaning-making, and the boundaries between simulation and genuine comprehension. As artificial systems advance, further integration of biological principles may offer a path towards more sophisticated semantic models. However, it remains an open question whether that will reach the same level as the human brain.&lt;br /&gt;
&lt;br /&gt;
===References===&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=File:Rnn.png&amp;diff=733</id>
		<title>File:Rnn.png</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=File:Rnn.png&amp;diff=733"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=734</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=734"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: User moved page Applications of Neural Networks to Encoding Semantics to Applications of Neural Networks to Semantic Understanding&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
The exploration of semantics in artificial neural networks has profound implications for both science and philosophy. While artificial systems have made remarkable advancements in representing and processing semantic information, their methods remain fundamentally different from those of biological systems. These differences highlight critical questions about the nature of understanding, the role of experience in meaning-making, and the boundaries between simulation and genuine comprehension. As artificial systems advance, further integration of biological principles may offer a path towards more sophisticated semantic models. However, it remains an open question whether that will reach the same level as the human brain.&lt;br /&gt;
&lt;br /&gt;
===References===&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Encoding_Semantics&amp;diff=735</id>
		<title>Applications of Neural Networks to Encoding Semantics</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Encoding_Semantics&amp;diff=735"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: User moved page Applications of Neural Networks to Encoding Semantics to Applications of Neural Networks to Semantic Understanding&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;#REDIRECT [[Applications of Neural Networks to Semantic Understanding]]&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=736</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=736"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* References */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
The exploration of semantics in artificial neural networks has profound implications for both science and philosophy. While artificial systems have made remarkable advancements in representing and processing semantic information, their methods remain fundamentally different from those of biological systems. These differences highlight critical questions about the nature of understanding, the role of experience in meaning-making, and the boundaries between simulation and genuine comprehension. As artificial systems advance, further integration of biological principles may offer a path towards more sophisticated semantic models. However, it remains an open question whether that will reach the same level as the human brain.&lt;br /&gt;
&lt;br /&gt;
===References===&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=737</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=737"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* References */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
The exploration of semantics in artificial neural networks has profound implications for both science and philosophy. While artificial systems have made remarkable advancements in representing and processing semantic information, their methods remain fundamentally different from those of biological systems. These differences highlight critical questions about the nature of understanding, the role of experience in meaning-making, and the boundaries between simulation and genuine comprehension. As artificial systems advance, further integration of biological principles may offer a path towards more sophisticated semantic models. However, it remains an open question whether that will reach the same level as the human brain.&lt;br /&gt;
&lt;br /&gt;
===References===&lt;br /&gt;
&amp;lt;references&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=738</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=738"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* References */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
The exploration of semantics in artificial neural networks has profound implications for both science and philosophy. While artificial systems have made remarkable advancements in representing and processing semantic information, their methods remain fundamentally different from those of biological systems. These differences highlight critical questions about the nature of understanding, the role of experience in meaning-making, and the boundaries between simulation and genuine comprehension. As artificial systems advance, further integration of biological principles may offer a path towards more sophisticated semantic models. However, it remains an open question whether that will reach the same level as the human brain.&lt;br /&gt;
&lt;br /&gt;
===References===&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=File:Piano_roll.webp&amp;diff=739</id>
		<title>File:Piano roll.webp</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=File:Piano_roll.webp&amp;diff=739"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=File:Vanishing_gradient_.png&amp;diff=740</id>
		<title>File:Vanishing gradient .png</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=File:Vanishing_gradient_.png&amp;diff=740"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=741</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=741"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* Mechanisms for semantic representation in the brain */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[&amp;lt;/ref&amp;gt;https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[&amp;lt;/ref&amp;gt;https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [&amp;lt;/ref&amp;gt;https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [&amp;lt;/ref&amp;gt;https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [&amp;lt;/ref&amp;gt;https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[&amp;lt;/ref&amp;gt;https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [&amp;lt;/ref&amp;gt;https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[&amp;lt;/ref&amp;gt;https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
The exploration of semantics in artificial neural networks has profound implications for both science and philosophy. While artificial systems have made remarkable advancements in representing and processing semantic information, their methods remain fundamentally different from those of biological systems. These differences highlight critical questions about the nature of understanding, the role of experience in meaning-making, and the boundaries between simulation and genuine comprehension. As artificial systems advance, further integration of biological principles may offer a path towards more sophisticated semantic models. However, it remains an open question whether that will reach the same level as the human brain.&lt;br /&gt;
&lt;br /&gt;
===References===&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=File:Lstm_model.webp&amp;diff=742</id>
		<title>File:Lstm model.webp</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=File:Lstm_model.webp&amp;diff=742"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=743</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=743"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* Mechanisms for semantic representation in the brain */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
The exploration of semantics in artificial neural networks has profound implications for both science and philosophy. While artificial systems have made remarkable advancements in representing and processing semantic information, their methods remain fundamentally different from those of biological systems. These differences highlight critical questions about the nature of understanding, the role of experience in meaning-making, and the boundaries between simulation and genuine comprehension. As artificial systems advance, further integration of biological principles may offer a path towards more sophisticated semantic models. However, it remains an open question whether that will reach the same level as the human brain.&lt;br /&gt;
&lt;br /&gt;
===References===&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=File:Vanishing_gradient.png&amp;diff=744</id>
		<title>File:Vanishing gradient.png</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=File:Vanishing_gradient.png&amp;diff=744"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=745</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=745"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;Ryan Cooper&lt;br /&gt;
&lt;br /&gt;
In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
The exploration of semantics in artificial neural networks has profound implications for both science and philosophy. While artificial systems have made remarkable advancements in representing and processing semantic information, their methods remain fundamentally different from those of biological systems. These differences highlight critical questions about the nature of understanding, the role of experience in meaning-making, and the boundaries between simulation and genuine comprehension. As artificial systems advance, further integration of biological principles may offer a path towards more sophisticated semantic models. However, it remains an open question whether that will reach the same level as the human brain.&lt;br /&gt;
&lt;br /&gt;
===References===&lt;br /&gt;
&amp;lt;references /&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Artificial_Intelligence_Music_Creation_with_Neural_Networks&amp;diff=746</id>
		<title>Artificial Intelligence Music Creation with Neural Networks</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Artificial_Intelligence_Music_Creation_with_Neural_Networks&amp;diff=746"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;''by Sid Singh''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
 Artificial Intelligence (AI) music creation is using generative artificial intelligence to produce music, often that aims to resemble human-made music. [https://en.wikipedia.org/wiki/Generative_artificial_intelligence]&lt;br /&gt;
To replicate human-created music compositions, a deep learning model is used. Deep learning models, a type of artificial neural network, are representations of the human brain that perform tasks such as classification and representation, such as finding a common note or pattern in music. [https://en.wikipedia.org/wiki/Deep_learning] The models use training data, such as human-made music, as well as hidden (&amp;quot;deep&amp;quot;) layers to train a randomized input into the desired output -- artificially created music that resembles a human creation. The use and popularity of music created by generative AI has skyrocketed in recent years [https://mixmag.net/read/73-of-producers-believe-ai-music-generators-could-replace-them-new-data-shows-tech], with its reception being a mixed bag of critics and believers. [https://www.nytimes.com/2023/05/11/learning/what-students-are-saying-about-ai-generated-music.html]&lt;br /&gt;
&lt;br /&gt;
'''History of AI Music'''&lt;br /&gt;
----&lt;br /&gt;
&lt;br /&gt;
 Artists and engineers have aimed to transcribe and recreate music since the 19th century, when music rolls were introduced commercially. Music rolls, typically made for reproducing piano, are sheets of paper with holes that model the notes and rhythm of music [https://www.pianola.org/history/history_rolls.cfm]. When these sheets are moved over a tracker bar, the instrument can recreate the piece without a human player. &lt;br /&gt;
&lt;br /&gt;
[[File:piano roll.jpg]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The modern-day, digital version of a music roll is a Musical Instrument Digital Interface (MIDI) file, which was introduced in the late 20th century by Dave Smith [https://hosatech.com/press-release/history-of-midi/]. Now, MIDI files are often the input for deep learning models to learn music. Before MIDI, though, AI music had already begun being generated; in 1957, composers Lejaren Hiller and Leonard Isaacson created The Illiac Suite, the first known computer-composed piece of music. [https://distributedmuseum.illinois.edu/exhibit/illiac-suite/] Since then, the scope and capability of Artificial music has greatly expanded. Recent projects such as Google's Magenta Project [https://magenta.tensorflow.org/] and OpenAI's MuseNet [https://openai.com/index/musenet/] allow users to give the computer certain requirements, such as instruments and lyrics to include, to create unique artificial arrangements. Artificial &amp;quot;deepfakes&amp;quot; of popular artists are another recent development of the AI music realm; the song &amp;quot;Heart on My Sleeve&amp;quot;, which imitates the voices of popular artists Drake and The Weeknd, gained over 15 million views on social media platform, TikTok, and over 600,000 streams on popular streaming platform Spotify. [https://www.washingtonpost.com/music/2023/04/26/ai-drake-weeknd/]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Recurrent Neural Networks (RNN)'''&lt;br /&gt;
&lt;br /&gt;
A recurrent neural network is a type of deep-learning model that takes a sequential set of inputs, puts it through hidden layers that have randomized weights, and then trains the model to eventually minimize the loss between the actual output and the desired output (the music desired). A recurrent neural network uses back-propagation, meaning the outputs of each node can be used as the new input. Since music is fundamentally a sequence of notes, rhythms, and pitches, the recurrent neural network is an ideal tool to generate an artificial musical output. Moreover, compared to a feed-forward or Conventional Neural Network (CNN), a recurrent neural network factors in the ordering of data points. [https://local.cis.strath.ac.uk/wp/extras/msctheses/papers/strath_cis_publication_2725.pdf] With music, the long-term sequence and order of notes are vital to predict every ensuing note, so a feed-forward network would not suffice.&lt;br /&gt;
&lt;br /&gt;
[[File:rnn.png]] [https://stanford.edu/~shervine/teaching/cs-230/cheatsheet-recurrent-neural-networks]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
A recurrent neural network works by receiving a sequential input, such as a MIDI file, which stores a set of musical notes, rhythm, and pitch. In a supervised recurrent neural network, the model would also receive a given output it should reach, which is a different sequence of musical notes, rhythm, and pitch. To reach this output layer, the model trains by going through nodes in layers, with a weight assigned to each node. The model takes the output from each layer at time t, as well as the given input, to use as the next input for time t + 1. As the model trains through its hidden layers, the weights of each node adjust to minimize the loss. [https://medium.com/@james.matson_64120/artificial-intelligence-music-creation-with-recurrent-neural-networks-rnn-be08d1d3c759] So, when given the input, the model will calculate the probability vector of each possible ensuing note/chord, rhythm, and pitch, given the previous inputs. Next, the model will compute the loss function and take the average of the loss on each note to get an overall loss function. The loss function can be implemented in various ways, but is commonly the cross-entropy loss function, which takes the difference between between the predicted output layer and the target output. Finally, the model will iterate and generate a new probability function given the new weights, until it eventually reaches the output layer. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
''' Limitations of the RNN'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
However, recurrent neural networks have a few problems that limit their capability; firstly, there is a vanishing gradient problem, which means the information stored in the earlier hidden layers of a network is lost because most of the back-propagated information comes from the later hidden layers. Moreover, the further you go into your network, the harder it is to train your model as the gradients (or slopes) get smaller and the weights given to the starting layers are smaller. A vanishing gradient problem occurs when the starting weights of the model are close to zero, and the gradients are less than 1. Given that the notes and rhythms at the start of a musical piece are important to predicting future notes and rhythms, the vanishing gradient problem limits the RNN's accuracy. [https://www.superdatascience.com/blogs/recurrent-neural-networks-rnn-the-vanishing-gradient-problem]&lt;br /&gt;
&lt;br /&gt;
[[File:vanishing gradient.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Another challenge with RNNs, which is essentially the opposite of the vanishing gradient problem, is the exploding gradient. In this case, during the backpropagation of the network, the gradients (or slopes) of each hidden layer get exponentially larger as we move backward. The exploding gradient problem occurs when the initial weights are too high, which leads to higher ensuing gradients (which are greater than 1). The exploding gradient problem makes it tough for a model to converge to any values as the parameters become so large that they overflow. [[https://www.geeksforgeeks.org/vanishing-and-exploding-gradients-problems-in-deep-learning/]]&lt;br /&gt;
&lt;br /&gt;
'''Long-Short Term Memory (LSTM) Models ''' &lt;br /&gt;
&lt;br /&gt;
To solve the vanishing and exploding gradient problems in AI music generation, a Long-Short Term Memory (LSTM) model can be used, which is a variation of an RNN, that achieves better transmission of information between the layers in the neural network.[https://web.stanford.edu/class/archive/cs/cs224n/cs224n.1204/reports/custom/report11.pdf] An LSTM does this by including a forget gate/vector, along with an input and output, that controls the self-recurrent link of the memory cell to remember and forget previous states whenever required. [https://www.sciencedirect.com/science/article/abs/pii/B9780128213797000035] Numerically, this allows for the LSTM to control the gradient from being too high or too low, and set it equal to just 1.&lt;br /&gt;
&lt;br /&gt;
[[File:lstm model.webp]]&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=747</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=747"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* References */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;Ryan Cooper&lt;br /&gt;
&lt;br /&gt;
In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
The exploration of semantics in artificial neural networks has profound implications for both science and philosophy. While artificial systems have made remarkable advancements in representing and processing semantic information, their methods remain fundamentally different from those of biological systems. These differences highlight critical questions about the nature of understanding, the role of experience in meaning-making, and the boundaries between simulation and genuine comprehension. As artificial systems advance, further integration of biological principles may offer a path towards more sophisticated semantic models. However, it remains an open question whether that will reach the same level as the human brain.&lt;br /&gt;
&lt;br /&gt;
===References===&lt;br /&gt;
&amp;lt;ref&amp;gt;Author's Name, &amp;quot;Title of the Source,&amp;quot; Publication, Date, URL (if applicable).&amp;lt;/ref&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=748</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=748"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* References */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;Ryan Cooper&lt;br /&gt;
&lt;br /&gt;
In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
The exploration of semantics in artificial neural networks has profound implications for both science and philosophy. While artificial systems have made remarkable advancements in representing and processing semantic information, their methods remain fundamentally different from those of biological systems. These differences highlight critical questions about the nature of understanding, the role of experience in meaning-making, and the boundaries between simulation and genuine comprehension. As artificial systems advance, further integration of biological principles may offer a path towards more sophisticated semantic models. However, it remains an open question whether that will reach the same level as the human brain.&lt;br /&gt;
&lt;br /&gt;
===References===&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=749</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=749"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* References */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;Ryan Cooper&lt;br /&gt;
&lt;br /&gt;
In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
The exploration of semantics in artificial neural networks has profound implications for both science and philosophy. While artificial systems have made remarkable advancements in representing and processing semantic information, their methods remain fundamentally different from those of biological systems. These differences highlight critical questions about the nature of understanding, the role of experience in meaning-making, and the boundaries between simulation and genuine comprehension. As artificial systems advance, further integration of biological principles may offer a path towards more sophisticated semantic models. However, it remains an open question whether that will reach the same level as the human brain.&lt;br /&gt;
&lt;br /&gt;
===References===&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Semantic Text Matching Using Convolutional Neural Networks https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Runfen Wang&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Amazon Web Serices&lt;br /&gt;
What is a recurrent neural network&lt;br /&gt;
https://aws.amazon.com/what-is/recurrent-neural-network/&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=750</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=750"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* References */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;Ryan Cooper&lt;br /&gt;
&lt;br /&gt;
In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
The exploration of semantics in artificial neural networks has profound implications for both science and philosophy. While artificial systems have made remarkable advancements in representing and processing semantic information, their methods remain fundamentally different from those of biological systems. These differences highlight critical questions about the nature of understanding, the role of experience in meaning-making, and the boundaries between simulation and genuine comprehension. As artificial systems advance, further integration of biological principles may offer a path towards more sophisticated semantic models. However, it remains an open question whether that will reach the same level as the human brain.&lt;br /&gt;
&lt;br /&gt;
===References===&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Runfen Wang&lt;br /&gt;
Semantic Text Matching Using Convolutional Neural Networks https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Amazon Web Serices&lt;br /&gt;
What is a recurrent neural network&lt;br /&gt;
https://aws.amazon.com/what-is/recurrent-neural-network/&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=751</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=751"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* References */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;Ryan Cooper&lt;br /&gt;
&lt;br /&gt;
In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
The exploration of semantics in artificial neural networks has profound implications for both science and philosophy. While artificial systems have made remarkable advancements in representing and processing semantic information, their methods remain fundamentally different from those of biological systems. These differences highlight critical questions about the nature of understanding, the role of experience in meaning-making, and the boundaries between simulation and genuine comprehension. As artificial systems advance, further integration of biological principles may offer a path towards more sophisticated semantic models. However, it remains an open question whether that will reach the same level as the human brain.&lt;br /&gt;
&lt;br /&gt;
===References===&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Runfen Wang,&lt;br /&gt;
Semantic Text Matching Using Convolutional Neural Networks,. https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Amazon Web Services,&lt;br /&gt;
What is a recurrent neural network,&lt;br /&gt;
https://aws.amazon.com/what-is/recurrent-neural-network/&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Google, word2vec,. https://code.google.com/archive/p/word2vec/&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Devjyoti Chakraborty, Aritra Roy Gosthipaty,&lt;br /&gt;
An Introduction to the Global Vectors (GloVe) Algorithm,. https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Kawin Ethayarajh,&lt;br /&gt;
BERT, ELMo, &amp;amp; GPT-2: How Contextual are Contextualized Word Representations?,. https://ai.stanford.edu/blog/contextual/&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Britney Muller,&lt;br /&gt;
How Does BERT Work?,. https://huggingface.co/blog/bert-101#2-how-does-bert-work&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Open AI GPT,. https://huggingface.co/docs/transformers/en/model_doc/openai-gpt&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Cohen Y, Engel TA, Langdon C, Lindsay GW, Ott T, Peters MAK, Shine JM, Breton-Provencher V, Ramaswamy S,&lt;br /&gt;
ecent Advances at the Interface of Neuroscience and Artificial Neural Networks,. https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.&amp;lt;/ref&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=752</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=752"/>
				<updated>2022-10-22T11:27:37Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* References */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;Ryan Cooper&lt;br /&gt;
&lt;br /&gt;
In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
The ability of neural networks to encode semantics sparks debates about understanding, consciousness, and the nature of mind. While artificial systems like neural networks process semantics through mathematical representations, critics argue that these systems lack true understanding or subjective experience. This perspective is perhaps best exemplified by John Searle’s Chinese Room argument, which suggests that artificial systems manipulate data without genuinely knowing the meaning of their outputs[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. The general conclusion of such arguments is that language data on its own is not sufficient for semantic understanding. Counter arguments in favor of artificial systems having the capacity for genuine semantic understanding typically focus on the functional capabilities of these systems rather than the experiential component of artificial understanding. One such counter argument takes a functionalist approach— suggesting that semantic understanding should be judged off the ability of a system to produce meaningful responses[https://plato.stanford.edu/entries/chinese-room/#SyntSema]. Another focuses on the possibility of emergent understanding in future advanced artificial systems. This line of argument emphasizes that as artificial networks grow in complexity, they may develop forms of semantic understanding that are indistinguishable from human understanding. &lt;br /&gt;
&lt;br /&gt;
The ability of neural networks to encode and process semantics challenges foundational concepts in the philosophy of language. It forces a reexamination of what it means to understand, how meaning is constructed, and whether non-biological entities can ever fully participate in linguistic systems.&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
The exploration of semantics in artificial neural networks has profound implications for both science and philosophy. While artificial systems have made remarkable advancements in representing and processing semantic information, their methods remain fundamentally different from those of biological systems. These differences highlight critical questions about the nature of understanding, the role of experience in meaning-making, and the boundaries between simulation and genuine comprehension. As artificial systems advance, further integration of biological principles may offer a path towards more sophisticated semantic models. However, it remains an open question whether that will reach the same level as the human brain.&lt;br /&gt;
&lt;br /&gt;
===References===&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Runfen Wang,&lt;br /&gt;
Semantic Text Matching Using Convolutional Neural Networks,. https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Amazon Web Services,&lt;br /&gt;
What is a recurrent neural network,&lt;br /&gt;
https://aws.amazon.com/what-is/recurrent-neural-network/&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Google, word2vec,. https://code.google.com/archive/p/word2vec/&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Devjyoti Chakraborty, Aritra Roy Gosthipaty,&lt;br /&gt;
An Introduction to the Global Vectors (GloVe) Algorithm,. https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Kawin Ethayarajh,&lt;br /&gt;
BERT, ELMo, &amp;amp; GPT-2: How Contextual are Contextualized Word Representations?,. https://ai.stanford.edu/blog/contextual/&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Saskia L. Frisby, Ajay D. Halai, Christopher R. Cox, Matthew A. Lambon Ralph, Timothy T. Rogers,&lt;br /&gt;
Decoding semantic representations in mind and brain,. https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Britney Muller,&lt;br /&gt;
How Does BERT Work?,. https://huggingface.co/blog/bert-101#2-how-does-bert-work&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Open AI GPT,. https://huggingface.co/docs/transformers/en/model_doc/openai-gpt&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;Cohen Y, Engel TA, Langdon C, Lindsay GW, Ott T, Peters MAK, Shine JM, Breton-Provencher V, Ramaswamy S,&lt;br /&gt;
Recent Advances at the Interface of Neuroscience and Artificial Neural Networks,. https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;ref&amp;gt;David Cole,&lt;br /&gt;
The Chinese Room Argument,. https://plato.stanford.edu/archives/win2024/entries/chinese-room/&amp;lt;/ref&amp;gt;&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	<entry>
		<id>http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=728</id>
		<title>Applications of Neural Networks to Semantic Understanding</title>
		<link rel="alternate" type="text/html" href="http://brainengineering.dartmouth.edu/psyc40wiki/index.php?title=Applications_of_Neural_Networks_to_Semantic_Understanding&amp;diff=728"/>
				<updated>2022-10-22T11:27:36Z</updated>
		
		<summary type="html">&lt;p&gt;User: /* Comparison of biological and artificial systems */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;In the context of artificial neural networks, semantics refers to the capabilities of networks to understand and represent the meaning of information, specifically how the meaning of words and sentences are discerned. The advance of neural networks in recent decades has had a profound impact on both neuroscience and philosophy dealing with semantic processing and understanding. &lt;br /&gt;
&lt;br /&gt;
In the brain, semantics are processed by networks of neurons in several regions of the brain. The specific neural underpinnings of semantic understanding is a currently evolving area of research, with a variety of hypotheses on the exact mechanisms for semantic processing in the brain being explored at this time. Nevertheless, the brain’s ability to continually learn and refine its semantic understanding has provided an important model for advancements in artificial systems attempting to emulate these features. &lt;br /&gt;
&lt;br /&gt;
In artificial systems, neural networks analyze linguistic data— identifying patterns to realize context and relationships between such data to create representations of meaning. A variety of model types are popular for attempting to encode semantics, including convolutional neural networks (CNN), recurrent neural networks (RNN), and transformer models.&lt;br /&gt;
&lt;br /&gt;
===Mechanisms for semantic representation in the brain===&lt;br /&gt;
Semantic processing in the brain involves a network of interconnected brain regions that work together to interpret language data and assign semantic meaning. While definite consensus on which regions of the brain are responsible for semantic processing and what their exact mechanism is has not yet been reached, neuroimaging studies have indicated that a distinct set of 7 regions is reliably activated during semantic processing[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These include the posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
[[File:Https---ars.els-cdn.com-content-image-1-s2.0-S1364661322003230-gr1.jpg]]&lt;br /&gt;
&lt;br /&gt;
Computational hypotheses about how semantic information is encoded can be grouped into three model types, category-based, feature-based, and vector space representations [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. In the first type of model, semantic concepts are processed as numerous discrete categories that correspond to a given input— terms with similar concepts are associated together and activate the same regions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The second posits that semantic information is processed as a number of different features, with each perceived component being linked to its associated features— similar concepts are associated with each other based on common properties [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. These two approaches allow semantic data to be thought of as vectors existing in high dimensional space, with the category-based model encoding data as belonging to distinct categories and the feature-based model encoding specific terms as vectors with high values in the features they are associated with[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. The last of these proposals models semantic information as also existing in a high dimensional space, but without any interpretable meaning for its corresponding dimensions [https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005]. Concepts can be understood as similar to each other based on where their vectors are located in the model[https://www.sciencedirect.com/science/article/pii/S1364661322003230#s0005].&lt;br /&gt;
&lt;br /&gt;
===Representations of semantics in artificial neural networks===&lt;br /&gt;
Three of the most popular artificial architectures for understanding semantic information are convolutional neural networks, recurrent neural networks, and transformer models. CNNs process semantic information by applying convolutional filters over semantic data to capture patterns and features of the data, deriving an understanding of semantic relationships in text [https://www.diva-portal.org/smash/get/diva2:1252494/FULLTEXT01.pdf]. RNNs are commonly used to handle sequential data like what is seen with semantic processing. One type of RNN commonly used for semantic processing is Long short-term memory models— these add a mechanism of gates on each cell that allows the model to retain information longer and better understand semantic information over a larger context[https://aws.amazon.com/what-is/recurrent-neural-network/]. Transformer models, introduced in 2017, have become the standard architecture for processing semantic information. These models employ attention mechanisms that allow the model to weigh the relevance of one word or part of a set of semantic information relative to each other. Text is converted to numerical tokens by these models, and then weighted using the attention mechanism to consider the whole semantic context of given information, improving understanding of the relationship between terms. &lt;br /&gt;
&lt;br /&gt;
Semantic encoding in artificial neural networks relies on different techniques to represent and help process semantic meaning. Embedding techniques like word2vec and GloVe are used by models to create vector relationships where words with similar meanings are mapped closer together, allowing for understanding of semantic meaning in situations like similes or analogies [https://code.google.com/archive/p/word2vec/][https://wandb.ai/authors/embeddings-2/reports/An-Introduction-to-the-Global-Vectors-GloVe-Algorithm--VmlldzozNDg2NTQ]. For more complex semantic understanding, &lt;br /&gt;
&lt;br /&gt;
Two important implementations of transformer architecture are GPTs and BERT.  These frameworks allow for more robust representation of semantic meaning by introducing techniques that allow for contextual embedding— this enables transformer models to represent semantic meaning in a more nuanced fashion [https://ai.stanford.edu/blog/contextual/]. BERT (Bidirectional Encoder Representations from Transformers) was developed in 2018 by Google to provide solutions to common language tasks— this sort of transformer model uses a large amount of data to pertain the model on a variety of tasks, allowing it to understand context better. It uses a bidirectional approach to consider both the words left and right in a given set of text, allowing for a more nuanced understanding of semantic meaning[https://huggingface.co/blog/bert-101#2-how-does-bert-work]. GPT (Generative Pretrained Transformer) was developed by OpenAI on a similar architecture. GPT processes semantic data in one direction, using a causal approach to predict the next word in a sequence[https://huggingface.co/docs/transformers/en/model_doc/openai-gpt]. &lt;br /&gt;
&lt;br /&gt;
Despite impressive results from artificial models, there still exist notable limitations and challenges for modeling semantics. Perhaps the most important being the question of what sort of understanding is being generated by artificial networks— while contemporary language models are becoming increasingly adept at representing semantics mathematically and dealing with complex semantic contexts, it is still unclear as to what sort of relationship this has to human semantic understanding. The methods of semantic processing in the brain rely on experience for inputs, which come in a much more complex, multimodal form. The development of multimodal language models may provide a closer link to what is seen in biological systems, but even so true semantic understanding from artificial systems may yet remain elusive.&lt;br /&gt;
&lt;br /&gt;
===Comparison of biological and artificial systems===&lt;br /&gt;
Biological neural systems and artificial neural networks share fundamental principles and mechanisms that form the basis for how they process information, including situations dealing with semantic information. However, despite these similarities, they also exhibit key differences in structure and function. Artificial architectures going back to the first perceptron models were in part inspired by brain structures— however when dealing with encoding of semantic information there are some important differences between biological and artificial systems. Most artificial neural networks focus on synaptic plasticity as the basis for memory, which is of course key for building semantic context [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. However, emerging theories in neurobiology say that other mechanisms including engram cells play an important role in memory [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. This indicates that further refinement is possible for biologically influenced artificial networks. One promising application of biological principles to advance semantic representation in artificial systems is the implementation of sleep-like states. During sleep, biological systems promote learning through processes like memory replay, which allows for better integration of new information into existing contexts [https://pmc.ncbi.nlm.nih.gov/articles/PMC9665920/#:~:text=Biological%20neural%20networks%20adapt%20and,and%20adaptability%20of%20biological%20cognition.]. The addition of biological principles to artificial systems could allow for the further improvement of semantic processing.&lt;br /&gt;
&lt;br /&gt;
===Philosophical implications of artificial models of semantic representation===&lt;br /&gt;
&lt;br /&gt;
===Conclusion===&lt;br /&gt;
&lt;br /&gt;
===References===&lt;/div&gt;</summary>
		<author><name>User</name></author>	</entry>

	</feed>