There are discussions of improving intelligence through genetic enhancement technology. Superhuman intelligence inside humans would have a better shot of being aligned with human values. I'm not sure about BCI though. Here are some examples of discussions of genetic enhancement of cognitive ability if you want to research further:
[1] As the other commenter Zach Stein-Perlman noted, there is a section in Nick Bostrom's Superintelligence books where he describes enhancing human cognition.
[2] Nick Bostrom and Carl Shulman have an article entitled "Embryo Selection for Cognitive Enhancement: Curiosity of Game-changer?"
[3] Steve Hsu, physicist and co-founder of Genomic Prediction, discusses cognitive enhancement. You can see his article "Super-Intelligent Humans Are Coming."
[4] Polymath Gwern Branwen has a very comprehensive article about genetic enhancement entitled "Embryo Selection for Intelligence." He evaluates the costs and benefits to different kinds of enhancement technology.
[5] A group of 13 researchers published "Screening Human Embryos for Polygenic Traits Has Limited Utility" in 2019. It discusses some of the current limitations, namely the limited ability to predict IQ. More research is needed to improve selection for intelligence. Height is further along.
[6] The other limitation is the number of embryos. The number of embryos that can be used will increase greatly if it is possible to have in vitro gametogenesis in humans. This has already been achieved in mice. You can see Metaculus estimates for this.
The extent to which you are excited about this might depend to some extent on what you believe will happen with artificial intelligence and how quickly. If we are all gone in 10 years, it might not matter much. If we have hundreds of millions of aligned superhuman brain emulations doing research, then maybe it doesn't matter as much how quickly we achieve these. However, if you have longer AI timelines, then it might be very useful in creating aligned artificial intelligence or mitigating other disasters if we have many superhuman geniuses, especially if they are morally enhanced.
I have an article that discusses how the political and social environment might change depending on how possible genetic enhancement scenarios might play out. I have a few other articles defending the practice. I'm really interested in this stuff, so you can message me if you want to discuss more.
Intelligence augmentation is generally regarded as relatively safe (and thus good to come before AI) but relatively difficult (and thus unlikely to come before AI). See Nick Bostrom's "Paths to superintelligence" in Superintelligence (2014).
This doesn't make much sense to me; I'm not aware of relevant work or reasons to believe this is promising. (Disclaimer: I'm not familiar with intelligence augmentation.)
I didn't know that in Superintelligence Bostrom talked about other paths to superintelligence, I need to read it ASAP.
Yeah, you are probably right, and I guess what I was trying to say was that the thing that pops in my mind when I think about possible paths to make us superintelligent is a hybrid between BCI and brain emulations.
And I was imagining that maybe neuron emulations could not be that difficult or that signals from AI "neurons" (something similar to present day NN) could be enough to be recognize as neurons by the brain.
Maybe that doesn't sound promising, but without having much knowledge in AI alignment, outer alignment sounds already like aligning human neural networks with an optimizer. And then to inner align you have to align the optimizer with an artificial neural network. This to me sound simpler: to align a type of NN with another.
But maybe it is wrong to think about the problem like that and the actual problem is easier.
I think that how important human cognitive enhancement might be depending on how quickly people think AI is coming and how transformative that AI will be. If we need aligned AI very quickly because we may all be wiped out, then that would take precedence. But if we have time, accelerating advances in human cognitive enhancement may be an extremely worthwhile endeavor. Morally and cognitively enhanced humans may be extremely motivated to do research in areas that EAs are interested in and create technology to mitigate disasters.